[ 532.186029] env[65701]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 532.186029] env[65701]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 533.195294] env[65788]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 533.195294] env[65788]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 535.027078] env[65788]: INFO neutron.common.config [-] Logging enabled! [ 535.027505] env[65788]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.1.0.dev61 [ 535.027624] env[65788]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65788) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 535.027921] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 535.028026] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 535.028885] env[65788]: WARNING oslo_policy.policy [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 535.029113] env[65788]: WARNING oslo_policy.policy [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 535.030788] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] VMware NSXv3 Agent initialized successfully. [ 535.031102] env[65788]: DEBUG oslo_concurrency.lockutils [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] Acquiring lock "singleton_lock" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.031258] env[65788]: DEBUG oslo_concurrency.lockutils [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] Acquired lock "singleton_lock" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.031460] env[65788]: DEBUG oslo_concurrency.lockutils [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] Releasing lock "singleton_lock" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.031744] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] Full set of CONF: {{(pid=65788) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 535.031849] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ******************************************************************************** {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 535.031952] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] Configuration options gathered from: {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 535.032521] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 535.032699] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 535.032807] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ================================================================================ {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 535.032975] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] agent_down_time = 75 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033125] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] allow_automatic_dhcp_failover = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033259] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] allow_bulk = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033397] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] api_extensions_path = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033532] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] api_paste_config = api-paste.ini {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033667] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] auth_strategy = keystone {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033768] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] backdoor_port = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033866] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] backdoor_socket = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.033998] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] backlog = 4096 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.034142] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.034295] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] bind_host = 0.0.0.0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.034430] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] bind_port = 9696 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.034558] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] client_socket_timeout = 900 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.034692] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] config_dir = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.034795] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.034930] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] config_source = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.035078] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] control_exchange = neutron {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.035212] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] core_plugin = ml2 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.035343] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] debug = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.035472] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] default_availability_zones = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.035678] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.035835] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] dhcp_agent_notification = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.035944] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] dhcp_agents_per_network = 1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.036082] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] dhcp_lease_duration = 86400 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.036217] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] dhcp_load_type = networks {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.036349] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] dns_domain = openstacklocal {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.036480] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.036608] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] enable_default_route_bfd = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.036761] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] enable_default_route_ecmp = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.036917] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] enable_dvr = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037060] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] enable_new_agents = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037355] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037355] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] enable_signals = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037485] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] enable_traditional_dhcp = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037574] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] external_dns_driver = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037677] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] filter_validation = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037809] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] global_physnet_mtu = 8950 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.037934] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] graceful_shutdown_timeout = 60 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.038115] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] host = cpu-1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.038251] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] host_dvr_for_dhcp = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.038376] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] http_retries = 3 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.038508] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] instance_format = [instance: %(uuid)s] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.038640] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.038774] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ipam_driver = internal {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.038928] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ipv6_pd_enabled = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.039077] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] l3_ha = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.039219] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.039352] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] l3_ha_network_physical_name = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.039482] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] l3_ha_network_type = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.039613] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_color = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.039742] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_config_append = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.039874] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040008] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_dir = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040134] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_file = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040233] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_options = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040359] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_rotate_interval = 1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040489] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_rotate_interval_type = days {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040618] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] log_rotation_type = none {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040717] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040814] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.040964] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041136] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041236] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041366] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] max_dns_nameservers = 5 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041492] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] max_header_line = 16384 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041619] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] max_l3_agents_per_router = 3 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041736] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] max_logfile_count = 30 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041858] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] max_logfile_size_mb = 200 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.041981] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] max_subnet_host_routes = 20 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.042132] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] my_ip = 10.180.1.21 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.042257] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] my_ipv6 = ::1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.042382] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] network_auto_schedule = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.042501] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] network_link_prefix = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.042633] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.042767] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] notify_nova_on_port_data_changes = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.042898] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] notify_nova_on_port_status_changes = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043041] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] pagination_max_limit = -1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043168] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] publish_errors = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043293] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] rate_limit_burst = 0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043422] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] rate_limit_except_level = CRITICAL {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043549] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] rate_limit_interval = 0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043672] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] retry_until_window = 30 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043795] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] router_distributed = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.043920] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] rpc_resources_processing_step = 20 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.044055] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] rpc_response_max_timeout = 600 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.044180] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] rpc_response_timeout = 60 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.044302] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] send_events_interval = 2 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.044440] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] service_plugins = ['router'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.044645] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] setproctitle = on {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.044810] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] shell_completion = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.044952] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] state_path = /opt/stack/data/neutron {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.045100] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] syslog_log_facility = LOG_USER {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.045234] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] tcp_keepidle = 600 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.045364] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] transport_url = **** {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.045489] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] use_journal = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.045613] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] use_json = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.045737] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] use_ssl = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046024] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] use_stderr = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046166] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] use_syslog = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046294] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] vlan_qinq = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046419] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] vlan_transparent = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046544] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] watch_log_file = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046669] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] wsgi_default_pool_size = 100 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046815] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] wsgi_keep_alive = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.046953] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.047093] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] wsgi_server_debug = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.047236] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_concurrency.disable_process_locking = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.047373] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.047508] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.047638] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.047773] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.047907] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.048047] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.048193] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.connection_string = messaging:// {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.048333] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.enabled = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.048468] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.es_doc_type = notification {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.048598] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.es_scroll_size = 10000 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.048730] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.es_scroll_time = 2m {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.048910] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.filter_error_trace = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.049073] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.hmac_keys = **** {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.049213] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.sentinel_service_name = mymaster {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.049350] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.socket_timeout = 0.1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.049481] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.trace_requests = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.049610] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler.trace_sqlalchemy = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.049753] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler_jaeger.process_tags = {} {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.049883] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler_jaeger.service_name_prefix = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.050020] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] profiler_otlp.service_name_prefix = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.050165] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.enforce_new_defaults = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.050438] env[65788]: WARNING oslo_config.cfg [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 535.050607] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.enforce_scope = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.050751] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.policy_default_rule = default {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.050896] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051052] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051195] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051323] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051450] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051574] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051701] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051832] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.051976] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.052128] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] agent.extensions = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.052274] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.052441] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] service_providers.service_provider = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.052585] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.default_quota = -1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.052726] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.052854] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_floatingip = 50 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.052984] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_network = 100 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.053125] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_port = 500 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.053252] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.053376] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_router = 10 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.053503] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_security_group = 10 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.053631] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.053758] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.quota_subnet = 100 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.053884] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] QUOTAS.track_quota_usage = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054037] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054169] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep.group = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054296] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep.helper_command = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054424] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep.log_daemon_traceback = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054555] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054682] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep.thread_pool_size = 8 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054809] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep.user = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.054946] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.055083] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_dhcp_release.group = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.055210] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_dhcp_release.helper_command = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.055360] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.055506] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.055636] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.055765] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_dhcp_release.user = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.055901] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056068] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_ovs_vsctl.group = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056203] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056332] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056463] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056591] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056721] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_ovs_vsctl.user = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056859] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_namespace.capabilities = [21] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.056982] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_namespace.group = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.057119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_namespace.helper_command = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.057246] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.057377] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.057508] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.057636] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_namespace.user = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.057770] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_conntrack.capabilities = [12] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.057890] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_conntrack.group = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058028] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_conntrack.helper_command = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058160] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058292] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058443] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058574] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_conntrack.user = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058710] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_link.capabilities = [12, 21] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058861] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_link.group = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.058995] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_link.helper_command = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.059141] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_link.log_daemon_traceback = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.059275] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.059404] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_link.thread_pool_size = 8 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.059530] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] privsep_link.user = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.059674] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.059814] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.059945] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.continue_on_failed_promotions = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.060083] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.dscp = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.060214] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.dscp_inherit = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.060350] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.force_mp_to_policy = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.060478] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.locking_coordinator_url = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.060607] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.log_agent_heartbeats = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.060738] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.logging_expire = 1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.060902] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.061059] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.061232] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.polling_interval = 240 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.061376] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.061516] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.061653] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.report_interval = 30.0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.061790] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.061925] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.062073] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.062210] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.sync_skew = 60 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.062342] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.synchronization_queue_size = 20 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.062472] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT.use_helper_for_ns_read = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.062608] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] SECURITYGROUP.enable_ipset = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.062746] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] SECURITYGROUP.enable_security_group = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.062880] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063024] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063164] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] experimental.ipv6_pd_enabled = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063314] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.extension_drivers = ['port_security'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063445] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.external_network_type = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063587] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063723] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.overlay_ip_version = 4 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063858] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.path_mtu = 8950 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.063993] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.physical_network_mtus = {} {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.064190] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.064355] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.064502] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ml2.type_drivers = ['vlan'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.064641] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.064771] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.064901] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.065067] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.065212] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.065348] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.065485] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.065623] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.065758] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.065947] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.066099] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_login_password = **** {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.066242] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.066374] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_login_user = admin {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.066510] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.066647] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.066839] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.066934] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.067084] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.067238] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.067403] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.067542] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.067678] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.067817] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.067959] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.068103] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.068240] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.068423] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.068564] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.068701] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.068858] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069010] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.auth_section = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069158] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.auth_type = password {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069294] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069422] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.certfile = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069549] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.collect_timing = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069687] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.endpoint_type = public {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069818] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.insecure = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.069944] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.keyfile = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.region_name = RegionOne {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.split_loggers = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] nova.timeout = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.auth_section = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.auth_type = password {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.certfile = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071350] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.collect_timing = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071350] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.endpoint_type = public {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071350] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.insecure = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071427] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.keyfile = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071542] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.region_name = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071595] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.split_loggers = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071721] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] placement.timeout = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071854] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.auth_section = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.071982] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.auth_type = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.072119] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.cafile = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.072246] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.certfile = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.072375] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.collect_timing = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.072498] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.connect_retries = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.072621] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.connect_retry_delay = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.072746] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.enable_notifications = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.072888] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.endpoint_override = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073045] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.insecure = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073175] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.interface = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073315] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.keyfile = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073458] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.max_version = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073585] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.min_version = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073710] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.region_name = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073833] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.retriable_status_codes = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.073958] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.service_name = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074092] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.service_type = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074220] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.split_loggers = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074337] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.status_code_retries = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074460] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.status_code_retry_delay = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074581] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.timeout = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074703] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.valid_interfaces = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074827] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ironic.version = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.074961] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] cli_script.dry_run = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.075114] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.075297] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.075390] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.075500] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.075631] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.075756] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.075872] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076008] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076141] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076276] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076423] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076564] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076700] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076853] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.076987] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.077134] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.077263] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.077390] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.077523] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.077651] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.077776] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.077901] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078037] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078166] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078294] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078420] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078547] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078673] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078805] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.078956] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.079103] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.ssl = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.079241] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.079397] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.079538] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.079675] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.079807] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.079938] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.080084] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_notifications.driver = [] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.080214] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_notifications.retry = -1 {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.080353] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.080478] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.080580] env[65788]: DEBUG oslo_service.backend._eventlet.service [None req-30cb6bb4-6d12-4996-ae39-9e6ee3820f01 None None] ******************************************************************************** {{(pid=65788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 535.081662] env[65788]: DEBUG neutron.agent.securitygroups_rpc [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Init firewall settings (driver=nsxv3) {{(pid=65788) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 535.082958] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65788) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 535.083211] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] RPC agent_id: nsxm-l-01a.corp.local [ 535.085406] env[65788]: DEBUG dogpile.cache.region [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 535.085543] env[65788]: DEBUG dogpile.lock [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 535.085647] env[65788]: DEBUG dogpile.lock [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 535.085729] env[65788]: DEBUG dogpile.lock [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 535.085820] env[65788]: DEBUG dogpile.cache.region [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 535.085908] env[65788]: DEBUG dogpile.lock [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 535.086038] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 535.109207] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Session token - acquiring [ 535.110838] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.111085] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.111197] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.111539] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.121979] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.396180] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 535.418610] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 535.418931] env[65788]: DEBUG dogpile.cache.region [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Cache value generated in 0.333 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 535.419050] env[65788]: DEBUG dogpile.lock [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 535.419188] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Activating Policy API Provider. [ 535.419396] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Looking for the default Infrastructure Rules. [ 535.490969] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Looking for the Default Layer3 Logged Drop Section. [ 535.507688] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 535.508221] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.508424] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.508525] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.508876] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.509243] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.027140] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.530717] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.033761] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Inventory metadata is going to be refreshed. [ 537.034172] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 537.802721] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.802984] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.803097] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.803414] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.814506] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 537.815453] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.816399] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 537.834630] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.834866] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.834908] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.835215] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.835338] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.835484] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 537.835595] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 537.835696] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 537.855715] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.855940] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.855988] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.856264] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.856443] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.856585] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 537.876725] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.876943] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.877064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.877385] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.877536] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.877677] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 537.899014] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.899264] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.899341] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.899562] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.899721] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.899897] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 537.900046] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 537.900087] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 537.918122] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.918380] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.918380] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.918658] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.919174] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.919174] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 537.919174] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 537.919285] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 537.939821] env[65788]: DEBUG networking_nsxv3.common.locking [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.940061] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.940104] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.940381] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.940520] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.940666] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 537.940769] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 537.940863] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Inventory metadata have been refreshed. [ 537.940984] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Dryrun:True. Metadata refresh completed. [ 537.941122] env[65788]: DEBUG oslo_concurrency.lockutils [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Releasing lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.942806] env[65788]: INFO neutron.agent.agent_extensions_manager [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Loaded agent extensions: [] [ 537.943526] env[65788]: DEBUG neutron_lib.callbacks.manager [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65788) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 538.005203] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent RPC Daemon Started! [ 538.005347] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent loop - iteration:0 started [ 538.005429] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent out of sync with plugin! [ 542.944531] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.944531] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.946158] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.946158] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 552.693552] env[65788]: INFO networking_nsxv3.common.synchronization [None req-65f3af81-29fe-426f-920c-b77d5b1d8de9 demo admin] Enqueued Resource ID: 3551e0ba-e7ab-41bd-ae21-636ae195d499 with Priority: HIGHEST for action security_group_rules [ 552.694105] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3551e0ba-e7ab-41bd-ae21-636ae195d499 with Priority: HIGHEST for action security_group_rules [ 552.694405] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3551e0ba-e7ab-41bd-ae21-636ae195d499 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.694530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3551e0ba-e7ab-41bd-ae21-636ae195d499" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.694596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3551e0ba-e7ab-41bd-ae21-636ae195d499" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.694923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3551e0ba-e7ab-41bd-ae21-636ae195d499" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.695016] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3551e0ba-e7ab-41bd-ae21-636ae195d499',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.217879] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.217879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.217879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.217879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.217879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.217879] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3551e0ba-e7ab-41bd-ae21-636ae195d499 already deleted. [ 553.217879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3551e0ba-e7ab-41bd-ae21-636ae195d499" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.695067] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.695566] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.696140] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.696549] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.697739] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.698168] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.703085] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 572.703085] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.946199] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.946704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.946704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.946704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.946883] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.449734] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.952418] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.455095] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 575.455225] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 576.213191] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.213191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.213562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.213562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.229026] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 576.229927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.231166] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 576.252979] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.252979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.253196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.253261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.253349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.253463] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 576.253618] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.253707] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 576.275695] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.275853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.275927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.276170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.276444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.276444] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.301761] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.301980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.301980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.302208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.302311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.302422] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.322482] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.322630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.322716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.322917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.323034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.323149] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 576.323223] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.323294] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 576.342364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.342519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.342560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.342757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.342845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.342958] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 576.343046] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.343145] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 576.369033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.369181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.369231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.369440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.369582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.369713] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 576.369781] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.369847] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 576.369921] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 576.369978] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 576.370056] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 576.370121] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 576.370795] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 576.370795] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 576.370795] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.394653] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.394862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.394862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.395113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.395221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.395334] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.420188] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.420369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.420458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.420735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.420930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.435052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.701188] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 577.701479] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 579.345492] env[65788]: INFO networking_nsxv3.common.synchronization [None req-fd610eb8-cc00-4f95-b32b-66c0086a0956 None None] Enqueued Resource ID: 2a92bcf4-6024-4082-92df-43954fe68f49 with Priority: HIGHEST for action port [ 579.348733] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a92bcf4-6024-4082-92df-43954fe68f49 with Priority: HIGHEST for action port [ 579.348733] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a92bcf4-6024-4082-92df-43954fe68f49 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.348733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a92bcf4-6024-4082-92df-43954fe68f49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.348733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a92bcf4-6024-4082-92df-43954fe68f49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.348733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a92bcf4-6024-4082-92df-43954fe68f49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.348733] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a92bcf4-6024-4082-92df-43954fe68f49',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.850904] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a92bcf4-6024-4082-92df-43954fe68f49 [ 579.850904] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.850904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.850904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.851787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.851913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.852150] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a92bcf4-6024-4082-92df-43954fe68f49 already deleted. [ 579.852415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a92bcf4-6024-4082-92df-43954fe68f49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.887160] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e7e1203a-d770-4755-a0aa-5d925ab3ae65 None None] Enqueued Resource ID: bea77316-2ec4-4b05-813b-e56b7282401f with Priority: HIGHEST for action port [ 579.887881] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea77316-2ec4-4b05-813b-e56b7282401f with Priority: HIGHEST for action port [ 579.888153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-bea77316-2ec4-4b05-813b-e56b7282401f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.888442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bea77316-2ec4-4b05-813b-e56b7282401f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.888442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bea77316-2ec4-4b05-813b-e56b7282401f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.889104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bea77316-2ec4-4b05-813b-e56b7282401f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.889104] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea77316-2ec4-4b05-813b-e56b7282401f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.391477] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bea77316-2ec4-4b05-813b-e56b7282401f [ 580.393280] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.393280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.393280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.393280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.393280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.393280] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bea77316-2ec4-4b05-813b-e56b7282401f already deleted. [ 580.393280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bea77316-2ec4-4b05-813b-e56b7282401f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.834049] env[65788]: INFO networking_nsxv3.common.synchronization [None req-81610ee6-e79e-4cfe-903c-f9559ae2037e None None] Enqueued Resource ID: e675c6d6-9597-4ee1-a396-836aa8a90c2c with Priority: HIGHEST for action port [ 581.834571] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e675c6d6-9597-4ee1-a396-836aa8a90c2c with Priority: HIGHEST for action port [ 581.835102] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e675c6d6-9597-4ee1-a396-836aa8a90c2c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.835102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e675c6d6-9597-4ee1-a396-836aa8a90c2c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.835102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e675c6d6-9597-4ee1-a396-836aa8a90c2c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.835358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e675c6d6-9597-4ee1-a396-836aa8a90c2c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.835406] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e675c6d6-9597-4ee1-a396-836aa8a90c2c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.340288] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e675c6d6-9597-4ee1-a396-836aa8a90c2c [ 582.340548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.340738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.340821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.341051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.341145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.341246] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e675c6d6-9597-4ee1-a396-836aa8a90c2c already deleted. [ 582.341328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e675c6d6-9597-4ee1-a396-836aa8a90c2c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.708120] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e7fb849c-25d7-493d-a75e-753ad1d42fe5 None None] Enqueued Resource ID: e52ed031-8a01-4f86-960b-7f5582669d3f with Priority: HIGHEST for action port [ 582.708680] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e52ed031-8a01-4f86-960b-7f5582669d3f with Priority: HIGHEST for action port [ 582.709017] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e52ed031-8a01-4f86-960b-7f5582669d3f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.709209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e52ed031-8a01-4f86-960b-7f5582669d3f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.709281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e52ed031-8a01-4f86-960b-7f5582669d3f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.709710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e52ed031-8a01-4f86-960b-7f5582669d3f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.709814] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52ed031-8a01-4f86-960b-7f5582669d3f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.213814] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e52ed031-8a01-4f86-960b-7f5582669d3f [ 583.214164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.214346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.214441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.214688] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.215187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.215294] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e52ed031-8a01-4f86-960b-7f5582669d3f already deleted. [ 583.215378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e52ed031-8a01-4f86-960b-7f5582669d3f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.226625] env[65788]: INFO networking_nsxv3.common.synchronization [None req-acd5b81a-e5c6-4ea5-b7e0-92c686f8d7b7 None None] Enqueued Resource ID: 4736853f-9e5d-4696-8649-fea1a81bb2b9 with Priority: HIGHEST for action port [ 584.226881] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4736853f-9e5d-4696-8649-fea1a81bb2b9 with Priority: HIGHEST for action port [ 584.227453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-4736853f-9e5d-4696-8649-fea1a81bb2b9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.227583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4736853f-9e5d-4696-8649-fea1a81bb2b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.227669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4736853f-9e5d-4696-8649-fea1a81bb2b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.227935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4736853f-9e5d-4696-8649-fea1a81bb2b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.228827] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4736853f-9e5d-4696-8649-fea1a81bb2b9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.467689] env[65788]: INFO networking_nsxv3.common.synchronization [None req-10400912-8ecd-465b-aee0-770d5c6d217b None None] Enqueued Resource ID: 4280040c-0467-4a62-96ea-18e117d9822c with Priority: HIGHEST for action port [ 584.467689] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4280040c-0467-4a62-96ea-18e117d9822c with Priority: HIGHEST for action port [ 584.467689] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-4280040c-0467-4a62-96ea-18e117d9822c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.467689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4280040c-0467-4a62-96ea-18e117d9822c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.467689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4280040c-0467-4a62-96ea-18e117d9822c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.467689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4280040c-0467-4a62-96ea-18e117d9822c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.467689] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4280040c-0467-4a62-96ea-18e117d9822c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.734724] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4736853f-9e5d-4696-8649-fea1a81bb2b9 [ 584.734724] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.734724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.734724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.734724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.734724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.735060] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4736853f-9e5d-4696-8649-fea1a81bb2b9 already deleted. [ 584.735060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4736853f-9e5d-4696-8649-fea1a81bb2b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.973877] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4280040c-0467-4a62-96ea-18e117d9822c [ 584.973994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.974161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.974230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.974468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.974527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.974617] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4280040c-0467-4a62-96ea-18e117d9822c already deleted. [ 584.974858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4280040c-0467-4a62-96ea-18e117d9822c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.876198] env[65788]: INFO networking_nsxv3.common.synchronization [None req-97f63d87-d170-4e9d-a3f5-b48353a1f53c None None] Enqueued Resource ID: f037d6f5-78ed-4097-9286-5f761c197110 with Priority: HIGHEST for action port [ 586.876662] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f037d6f5-78ed-4097-9286-5f761c197110 with Priority: HIGHEST for action port [ 586.877051] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f037d6f5-78ed-4097-9286-5f761c197110 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.877178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f037d6f5-78ed-4097-9286-5f761c197110" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.877245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f037d6f5-78ed-4097-9286-5f761c197110" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.877489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f037d6f5-78ed-4097-9286-5f761c197110" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.877574] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f037d6f5-78ed-4097-9286-5f761c197110',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.169680] env[65788]: INFO networking_nsxv3.common.synchronization [None req-45819595-447a-4e0f-8378-a7591c3e4096 None None] Enqueued Resource ID: 24a45560-a33a-4ca3-a5cf-0c365b669f72 with Priority: HIGHEST for action port [ 587.170305] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a45560-a33a-4ca3-a5cf-0c365b669f72 with Priority: HIGHEST for action port [ 587.170604] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-24a45560-a33a-4ca3-a5cf-0c365b669f72 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.170727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24a45560-a33a-4ca3-a5cf-0c365b669f72" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.170799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24a45560-a33a-4ca3-a5cf-0c365b669f72" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.171196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24a45560-a33a-4ca3-a5cf-0c365b669f72" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.171910] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24a45560-a33a-4ca3-a5cf-0c365b669f72',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.380406] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f037d6f5-78ed-4097-9286-5f761c197110 [ 587.380842] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.381032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.381411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.381761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.381864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.381968] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f037d6f5-78ed-4097-9286-5f761c197110 already deleted. [ 587.383013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f037d6f5-78ed-4097-9286-5f761c197110" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.677451] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24a45560-a33a-4ca3-a5cf-0c365b669f72 [ 587.677895] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.678223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.678223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.680016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.680016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.680016] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24a45560-a33a-4ca3-a5cf-0c365b669f72 already deleted. [ 587.680016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24a45560-a33a-4ca3-a5cf-0c365b669f72" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.509075] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b49196c6-9f47-4a7f-8f90-efcdace89d45 None None] Enqueued Resource ID: faa986a1-b6f1-4d03-9df5-b8a3bfe8e759 with Priority: HIGHEST for action port [ 588.509778] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa986a1-b6f1-4d03-9df5-b8a3bfe8e759 with Priority: HIGHEST for action port [ 588.510220] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-faa986a1-b6f1-4d03-9df5-b8a3bfe8e759 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.510546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faa986a1-b6f1-4d03-9df5-b8a3bfe8e759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.510734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faa986a1-b6f1-4d03-9df5-b8a3bfe8e759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.511183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faa986a1-b6f1-4d03-9df5-b8a3bfe8e759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.511364] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faa986a1-b6f1-4d03-9df5-b8a3bfe8e759',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.014836] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faa986a1-b6f1-4d03-9df5-b8a3bfe8e759 [ 589.014836] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.014836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.014836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.015143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.015177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.015274] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faa986a1-b6f1-4d03-9df5-b8a3bfe8e759 already deleted. [ 589.015353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faa986a1-b6f1-4d03-9df5-b8a3bfe8e759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.601875] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7de60f76-25d7-4abc-986b-8137a295cd97 None None] Enqueued Resource ID: dfb60519-22c1-41ed-af1a-333e475814e8 with Priority: HIGHEST for action port [ 589.603491] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb60519-22c1-41ed-af1a-333e475814e8 with Priority: HIGHEST for action port [ 589.603491] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb60519-22c1-41ed-af1a-333e475814e8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.603658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb60519-22c1-41ed-af1a-333e475814e8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.603658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb60519-22c1-41ed-af1a-333e475814e8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.603915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb60519-22c1-41ed-af1a-333e475814e8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.604008] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb60519-22c1-41ed-af1a-333e475814e8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.107816] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfb60519-22c1-41ed-af1a-333e475814e8 [ 590.108861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.108861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.108861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.108861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.108861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.108861] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfb60519-22c1-41ed-af1a-333e475814e8 already deleted. [ 590.108861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb60519-22c1-41ed-af1a-333e475814e8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.488643] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ec13f9f2-5d83-4616-9162-dc2271d897d5 None None] Enqueued Resource ID: 0080b597-3d50-48dc-adfd-757c4f834d88 with Priority: HIGHEST for action port [ 590.489464] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0080b597-3d50-48dc-adfd-757c4f834d88 with Priority: HIGHEST for action port [ 590.490208] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0080b597-3d50-48dc-adfd-757c4f834d88 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.490346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0080b597-3d50-48dc-adfd-757c4f834d88" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.490496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0080b597-3d50-48dc-adfd-757c4f834d88" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.491247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0080b597-3d50-48dc-adfd-757c4f834d88" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.491247] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0080b597-3d50-48dc-adfd-757c4f834d88',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.935789] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f2e834a2-2e6b-4161-a7b6-2dbab2a80196 None None] Enqueued Resource ID: 500ba9e6-7e34-4e98-8a65-d9f6c1acd18a with Priority: HIGHEST for action port [ 590.937809] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500ba9e6-7e34-4e98-8a65-d9f6c1acd18a with Priority: HIGHEST for action port [ 590.937809] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-500ba9e6-7e34-4e98-8a65-d9f6c1acd18a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.938049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-500ba9e6-7e34-4e98-8a65-d9f6c1acd18a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.938049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-500ba9e6-7e34-4e98-8a65-d9f6c1acd18a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.938798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-500ba9e6-7e34-4e98-8a65-d9f6c1acd18a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.938798] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('500ba9e6-7e34-4e98-8a65-d9f6c1acd18a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.993146] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0080b597-3d50-48dc-adfd-757c4f834d88 [ 590.993696] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.993696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.993696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.993902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.993902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.993956] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0080b597-3d50-48dc-adfd-757c4f834d88 already deleted. [ 590.994048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0080b597-3d50-48dc-adfd-757c4f834d88" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.372436] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e3203b3a-830a-41a1-835b-b6b7e1c7b381 None None] Enqueued Resource ID: d79470d8-154e-45e8-b272-036975b8196b with Priority: HIGHEST for action port [ 591.373116] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d79470d8-154e-45e8-b272-036975b8196b with Priority: HIGHEST for action port [ 591.373465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d79470d8-154e-45e8-b272-036975b8196b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.373542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d79470d8-154e-45e8-b272-036975b8196b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.374585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d79470d8-154e-45e8-b272-036975b8196b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.374585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d79470d8-154e-45e8-b272-036975b8196b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.374585] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d79470d8-154e-45e8-b272-036975b8196b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.443220] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 500ba9e6-7e34-4e98-8a65-d9f6c1acd18a [ 591.443709] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.444009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.444192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.444573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.444901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.445519] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:500ba9e6-7e34-4e98-8a65-d9f6c1acd18a already deleted. [ 591.445704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-500ba9e6-7e34-4e98-8a65-d9f6c1acd18a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.876831] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d79470d8-154e-45e8-b272-036975b8196b [ 591.877923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.878419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.878419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.878419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.878551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.879559] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d79470d8-154e-45e8-b272-036975b8196b already deleted. [ 591.879559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d79470d8-154e-45e8-b272-036975b8196b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.069124] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b1e3288f-23e9-49ba-8f38-7a1ca8bea423 None None] Enqueued Resource ID: 1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f with Priority: HIGHEST for action port [ 593.069372] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f with Priority: HIGHEST for action port [ 593.071020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.076231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.078784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.078784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.078784] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.582373] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f [ 593.582373] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.582373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.582636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.582636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.582726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.582772] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f already deleted. [ 593.582888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a2a24a2-6c09-40c8-bfa3-0d40fc40fc7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.120785] env[65788]: INFO networking_nsxv3.common.synchronization [None req-83195ba9-8277-44c2-af17-66d05410d987 None None] Enqueued Resource ID: 8ed78f6b-d805-4124-8239-ac007ab327f9 with Priority: HIGHEST for action port [ 594.121093] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ed78f6b-d805-4124-8239-ac007ab327f9 with Priority: HIGHEST for action port [ 594.121522] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ed78f6b-d805-4124-8239-ac007ab327f9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.121634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ed78f6b-d805-4124-8239-ac007ab327f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.121702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ed78f6b-d805-4124-8239-ac007ab327f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.121965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ed78f6b-d805-4124-8239-ac007ab327f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.122963] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed78f6b-d805-4124-8239-ac007ab327f9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.627493] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ed78f6b-d805-4124-8239-ac007ab327f9 [ 594.628199] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.628356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.628430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.628691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.628759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.628916] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ed78f6b-d805-4124-8239-ac007ab327f9 already deleted. [ 594.629017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ed78f6b-d805-4124-8239-ac007ab327f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.699709] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b4848fb-3aef-469e-b6ec-73b2513ab89d req-24a45f78-57d8-460e-8848-45bcded21701 tempest-ServerDiagnosticsTest-1327084598 tempest-ServerDiagnosticsTest-1327084598-project-member] Enqueued Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_members [ 594.699709] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_members [ 594.700417] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-900e89d4-a148-4692-80f4-3bd065e8007a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.700609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.700703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.701120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.702858] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.702858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.702858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.703076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.703185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.703322] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.922177] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7fb71fb3-a57c-4c2c-98bd-cd9dbea40447 None None] Enqueued Resource ID: 1e5cf0cc-8f30-4626-80be-6acdf0ee011e with Priority: HIGHEST for action port [ 594.922758] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5cf0cc-8f30-4626-80be-6acdf0ee011e with Priority: HIGHEST for action port [ 594.924175] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e5cf0cc-8f30-4626-80be-6acdf0ee011e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.924330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e5cf0cc-8f30-4626-80be-6acdf0ee011e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.924438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e5cf0cc-8f30-4626-80be-6acdf0ee011e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.924629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e5cf0cc-8f30-4626-80be-6acdf0ee011e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.924876] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5cf0cc-8f30-4626-80be-6acdf0ee011e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.205733] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.206463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.206571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.206769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.206861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.207117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.207333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.207333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.207503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.207503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.207591] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 900e89d4-a148-4692-80f4-3bd065e8007a already deleted. [ 595.207672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.428185] env[65788]: INFO networking_nsxv3.common.synchronization [None req-33bc2ec0-6c5a-4fd0-94fe-104c7f1c2476 None None] Enqueued Resource ID: 4a8688e7-47bc-441b-841c-3cf97cf1d195 with Priority: HIGHEST for action port [ 595.428485] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e5cf0cc-8f30-4626-80be-6acdf0ee011e [ 595.428681] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.428797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.429388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.429388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.429388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.429388] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e5cf0cc-8f30-4626-80be-6acdf0ee011e already deleted. [ 595.429388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e5cf0cc-8f30-4626-80be-6acdf0ee011e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.430407] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a8688e7-47bc-441b-841c-3cf97cf1d195 with Priority: HIGHEST for action port [ 595.430407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a8688e7-47bc-441b-841c-3cf97cf1d195 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.430407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a8688e7-47bc-441b-841c-3cf97cf1d195" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.430407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a8688e7-47bc-441b-841c-3cf97cf1d195" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.430766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a8688e7-47bc-441b-841c-3cf97cf1d195" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.431016] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a8688e7-47bc-441b-841c-3cf97cf1d195',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.933642] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a8688e7-47bc-441b-841c-3cf97cf1d195 [ 595.933879] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.933998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.934085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.934297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.934380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.934473] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a8688e7-47bc-441b-841c-3cf97cf1d195 already deleted. [ 595.934553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a8688e7-47bc-441b-841c-3cf97cf1d195" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.309277] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.309601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.309601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.309984] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.314824] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.314824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.314824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.314824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.314824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.314824] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.314824] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.314824] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.314824] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.314824] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.314824] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.314824] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.355855] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.356064] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.356202] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.358176] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.358725] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-57903cd2-5289-4e4e-82c5-f1c098d3a83d taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.358906] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.358995] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.359318] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.359446] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57903cd2-5289-4e4e-82c5-f1c098d3a83d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.842416] env[65788]: INFO networking_nsxv3.common.synchronization [None req-2bdb3e84-1ded-4183-8f12-f9dd1a0c2a96 None None] Enqueued Resource ID: 82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18 with Priority: HIGHEST for action port [ 596.843758] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18 with Priority: HIGHEST for action port [ 596.844419] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.844682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.844884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.845298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.845508] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.863044] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.864042] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.864633] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.865245] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.865774] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.866132] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 57903cd2-5289-4e4e-82c5-f1c098d3a83d not found, creating... [ 596.866733] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.867028] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.867392] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.867771] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.868726] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.869443] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.870100] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.870243] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.870640] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.871016] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.871301] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 57903cd2-5289-4e4e-82c5-f1c098d3a83d is going to be created. [ 596.896637] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.898370] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.898502] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.898789] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.899032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.899266] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.289500] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ed764e4f-bcf6-4366-9302-e5d26371e7f7 None None] Enqueued Resource ID: de44c1bd-9b32-4879-b6cf-229cac6eb485 with Priority: HIGHEST for action port [ 597.290351] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de44c1bd-9b32-4879-b6cf-229cac6eb485 with Priority: HIGHEST for action port [ 597.290351] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-de44c1bd-9b32-4879-b6cf-229cac6eb485 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.290483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de44c1bd-9b32-4879-b6cf-229cac6eb485" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.290548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de44c1bd-9b32-4879-b6cf-229cac6eb485" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.294827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de44c1bd-9b32-4879-b6cf-229cac6eb485" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.294827] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de44c1bd-9b32-4879-b6cf-229cac6eb485',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.348625] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18 [ 597.348982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.349173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.349520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.349520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.349625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.349669] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18 already deleted. [ 597.349753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82a37bb2-b67e-45e5-a0bb-d4fe3cc50a18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.796699] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de44c1bd-9b32-4879-b6cf-229cac6eb485 [ 597.797056] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.797188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.797188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.797461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.797530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.797626] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de44c1bd-9b32-4879-b6cf-229cac6eb485 already deleted. [ 597.797713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de44c1bd-9b32-4879-b6cf-229cac6eb485" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.803634] env[65788]: INFO networking_nsxv3.common.synchronization [req-294dcaf3-7704-41f9-8bb0-f41b543aa7e9 req-55aee363-e7e1-42e2-80c1-bb0a3698612b tempest-DeleteServersAdminTestJSON-2055679758 tempest-DeleteServersAdminTestJSON-2055679758-project-member] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 597.804292] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 597.804661] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.804811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.804910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.805298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.805575] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.805733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.805802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.805965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.806073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.806171] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.880825] env[65788]: INFO networking_nsxv3.common.synchronization [None req-4ab9ea61-9342-4c92-92f3-721003f1bedc None None] Enqueued Resource ID: 15110daa-04c9-4f41-8b67-7e9a37ff2f52 with Priority: HIGHEST for action port [ 597.881980] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15110daa-04c9-4f41-8b67-7e9a37ff2f52 with Priority: HIGHEST for action port [ 597.882356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-15110daa-04c9-4f41-8b67-7e9a37ff2f52 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.882485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15110daa-04c9-4f41-8b67-7e9a37ff2f52" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.882554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15110daa-04c9-4f41-8b67-7e9a37ff2f52" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.882794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15110daa-04c9-4f41-8b67-7e9a37ff2f52" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.882880] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15110daa-04c9-4f41-8b67-7e9a37ff2f52',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.090261] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b4848fb-3aef-469e-b6ec-73b2513ab89d req-6cde61a3-313e-4fbd-8881-3fdb2026e378 service nova] Enqueued Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_rules [ 598.090261] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b4848fb-3aef-469e-b6ec-73b2513ab89d req-6cde61a3-313e-4fbd-8881-3fdb2026e378 service nova] Enqueued Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_members [ 598.090261] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b4848fb-3aef-469e-b6ec-73b2513ab89d req-6cde61a3-313e-4fbd-8881-3fdb2026e378 service nova] Enqueued Resource ID: 57903cd2-5289-4e4e-82c5-f1c098d3a83d with Priority: HIGHEST for action port [ 598.090261] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_rules [ 598.090261] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_members [ 598.090261] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57903cd2-5289-4e4e-82c5-f1c098d3a83d with Priority: HIGHEST for action port [ 598.090261] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-900e89d4-a148-4692-80f4-3bd065e8007a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.090261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.090261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.090597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.090597] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.091278] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-900e89d4-a148-4692-80f4-3bd065e8007a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.091423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.091513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.093390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.094304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.094428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.094495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.096310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.096310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.096310] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.097931] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-57903cd2-5289-4e4e-82c5-f1c098d3a83d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.097931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.097931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.097931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.097931] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57903cd2-5289-4e4e-82c5-f1c098d3a83d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.308793] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.308976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.310088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.310088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.310088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.310088] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.310088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.310088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.310088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.310088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.310574] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de already deleted. [ 598.310574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.384824] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15110daa-04c9-4f41-8b67-7e9a37ff2f52 [ 598.385115] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.385217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.385275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.385507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.385594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.385695] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15110daa-04c9-4f41-8b67-7e9a37ff2f52 already deleted. [ 598.385777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15110daa-04c9-4f41-8b67-7e9a37ff2f52" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.600703] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-900e89d4-a148-4692-80f4-3bd065e8007a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.601020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.611533] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57903cd2-5289-4e4e-82c5-f1c098d3a83d with status ACTIVE [ 598.611779] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.611921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.611990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.612302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.612401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.612581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.612684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.612747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.612901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.612979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.613536] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.613536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.613536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.613536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.613536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.613844] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57903cd2-5289-4e4e-82c5-f1c098d3a83d is going to be updated. [ 598.615076] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.641506] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.642399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.642399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.642399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.642399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.642399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57903cd2-5289-4e4e-82c5-f1c098d3a83d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.645392] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.645643] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.645769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.646081] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.646392] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.646563] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.646686] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.646952] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.647126] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.647610] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.647610] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.647610] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.647740] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.647827] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.648326] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.648326] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.668379] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.668541] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.668781] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.668878] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.669310] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.669531] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.669531] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.670713] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.670713] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fab39ab0-71ee-4b5d-a40e-0752a3c9ff66',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.119088] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.174295] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.174526] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.174659] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.175016] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.175178] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.175333] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 not found, creating... [ 599.175590] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.175824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.175976] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.176284] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.176439] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.176788] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.177073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.177259] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.177450] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.177599] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.177789] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 is going to be created. [ 599.202067] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.202167] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.202307] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.202649] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.202916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.203143] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.598918] env[65788]: INFO networking_nsxv3.common.synchronization [None req-aa191eaa-e51a-49f5-922a-5720f537e2a8 None None] Enqueued Resource ID: 7f3ece46-3125-4703-b630-af36b087f38a with Priority: HIGHEST for action port [ 599.599490] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ece46-3125-4703-b630-af36b087f38a with Priority: HIGHEST for action port [ 599.599788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f3ece46-3125-4703-b630-af36b087f38a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.599934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f3ece46-3125-4703-b630-af36b087f38a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.600020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f3ece46-3125-4703-b630-af36b087f38a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.604416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f3ece46-3125-4703-b630-af36b087f38a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.604511] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f3ece46-3125-4703-b630-af36b087f38a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.622572] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.623302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.623302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.623302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.623302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.623302] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 900e89d4-a148-4692-80f4-3bd065e8007a is going to be created. [ 599.663428] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.663428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.663428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.663744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.664457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.675804] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 900e89d4-a148-4692-80f4-3bd065e8007a in Status: UNINITIALIZED for 2s [ 600.015496] env[65788]: INFO networking_nsxv3.common.synchronization [req-294dcaf3-7704-41f9-8bb0-f41b543aa7e9 req-8277722f-8c2e-4a16-be2e-8a1e5f1e3b9c service nova] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_rules [ 600.016221] env[65788]: INFO networking_nsxv3.common.synchronization [req-294dcaf3-7704-41f9-8bb0-f41b543aa7e9 req-8277722f-8c2e-4a16-be2e-8a1e5f1e3b9c service nova] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 600.016221] env[65788]: INFO networking_nsxv3.common.synchronization [req-294dcaf3-7704-41f9-8bb0-f41b543aa7e9 req-8277722f-8c2e-4a16-be2e-8a1e5f1e3b9c service nova] Enqueued Resource ID: fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 with Priority: HIGHEST for action port [ 600.016332] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_rules [ 600.016438] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 600.016566] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 with Priority: HIGHEST for action port [ 600.016794] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.018474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.018558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.018817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.018915] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.022096] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.022907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.022907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.022907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.022907] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.022907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.022907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.023158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.023158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.023217] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.026027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.026027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.026303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.027113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.027113] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fab39ab0-71ee-4b5d-a40e-0752a3c9ff66',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.111017] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f3ece46-3125-4703-b630-af36b087f38a [ 600.111017] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.111017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.111017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.111017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.111017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.111017] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f3ece46-3125-4703-b630-af36b087f38a already deleted. [ 600.111017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f3ece46-3125-4703-b630-af36b087f38a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.528771] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.528771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.528771] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.529604] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 with status ACTIVE [ 600.529784] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.531571] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.531571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.532034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.532034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.532164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.533102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.533102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.533102] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fab39ab0-71ee-4b5d-a40e-0752a3c9ff66 is going to be updated. [ 600.648189] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.648467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.648467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.648652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.648785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.648939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fab39ab0-71ee-4b5d-a40e-0752a3c9ff66" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.038614] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.542974] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.544276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.544276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.544276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.544276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.548183] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be created. [ 601.574206] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.574206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.574206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.574206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.574372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.590668] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: UNINITIALIZED for 2s [ 601.686121] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 900e89d4-a148-4692-80f4-3bd065e8007a in Status: SUCCESS [ 601.686552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.686788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.687551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.687784] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.688366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.688366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.688366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.688699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.688699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.688821] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.077832] env[65788]: INFO networking_nsxv3.common.synchronization [None req-71051ca8-6023-45b3-99f0-0772f2c22e91 None None] Enqueued Resource ID: 104ec75f-a8ed-4086-a0ec-13e5b8dc99f1 with Priority: HIGHEST for action port [ 602.078395] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 104ec75f-a8ed-4086-a0ec-13e5b8dc99f1 with Priority: HIGHEST for action port [ 602.078883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-104ec75f-a8ed-4086-a0ec-13e5b8dc99f1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.080145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-104ec75f-a8ed-4086-a0ec-13e5b8dc99f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.080145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-104ec75f-a8ed-4086-a0ec-13e5b8dc99f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.080145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-104ec75f-a8ed-4086-a0ec-13e5b8dc99f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.080145] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('104ec75f-a8ed-4086-a0ec-13e5b8dc99f1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.191202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-900e89d4-a148-4692-80f4-3bd065e8007a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.191451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.191451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.191578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.191744] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.191851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.191893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.192050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.192318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.192318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.192463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-900e89d4-a148-4692-80f4-3bd065e8007a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.192463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.192574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.192627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.192825] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.192935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.193010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.193152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.193404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.193404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.193404] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.584022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 104ec75f-a8ed-4086-a0ec-13e5b8dc99f1 [ 602.584022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.584022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.584022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.584022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.584022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.584022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:104ec75f-a8ed-4086-a0ec-13e5b8dc99f1 already deleted. [ 602.584451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-104ec75f-a8ed-4086-a0ec-13e5b8dc99f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.695557] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 900e89d4-a148-4692-80f4-3bd065e8007a: rpc.has_security_group_logging(os_id): False [ 602.715616] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.715616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.715616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.715616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.715616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.715616] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.716367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.716367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.716367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.716367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.716367] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.716367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.716367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.716609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.716609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.720514] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.720514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.720514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.720826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.720826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.720826] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 900e89d4-a148-4692-80f4-3bd065e8007a is going to be created. [ 602.764655] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ca90b647-d741-4f33-a5f9-494e7de8806b None None] Enqueued Resource ID: ddc2d164-0538-409a-9d88-c54ff2aafa1c with Priority: HIGHEST for action port [ 602.768891] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc2d164-0538-409a-9d88-c54ff2aafa1c with Priority: HIGHEST for action port [ 602.768891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddc2d164-0538-409a-9d88-c54ff2aafa1c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.768891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddc2d164-0538-409a-9d88-c54ff2aafa1c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.768891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddc2d164-0538-409a-9d88-c54ff2aafa1c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.769532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddc2d164-0538-409a-9d88-c54ff2aafa1c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.769532] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc2d164-0538-409a-9d88-c54ff2aafa1c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.804325] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.804520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.804520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.804724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.804902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.820336] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 900e89d4-a148-4692-80f4-3bd065e8007a in Status: IN_PROGRESS for 2s [ 602.986261] env[65788]: INFO networking_nsxv3.common.synchronization [None req-c04b7c83-6391-4093-99e1-13b6236668eb tempest-VolumesAssistedSnapshotsTest-2049452914 tempest-VolumesAssistedSnapshotsTest-2049452914-project-member] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_rules [ 602.986261] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_rules [ 602.986261] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.986261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.986261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.986261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.986261] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.271370] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddc2d164-0538-409a-9d88-c54ff2aafa1c [ 603.271712] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.272166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.272166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.272317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.272438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.272575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddc2d164-0538-409a-9d88-c54ff2aafa1c already deleted. [ 603.272713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddc2d164-0538-409a-9d88-c54ff2aafa1c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.309883] env[65788]: INFO networking_nsxv3.common.synchronization [req-86b718c1-923c-43fd-b276-2afedd5a9c51 req-ec5326f9-96ba-45ec-ba0e-3227c59de273 tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 603.311375] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 603.311375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.311375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.311603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.311691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.311923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.312116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.312221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.312424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.312515] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.312619] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.513356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.513609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.513609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.514207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.514207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.514207] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 already deleted. [ 603.514207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.521643] env[65788]: INFO networking_nsxv3.common.synchronization [None req-990a1044-8b5a-427b-8663-f75211176320 tempest-VolumesAssistedSnapshotsTest-2049452914 tempest-VolumesAssistedSnapshotsTest-2049452914-project-member] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_rules [ 603.522280] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_rules [ 603.522496] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.522625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.522692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.522894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.523103] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.603393] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: SUCCESS [ 603.603393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.603512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.603656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.603900] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.603979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.604482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.604482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.604482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.604482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.604710] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.742630] env[65788]: INFO networking_nsxv3.common.synchronization [None req-d5b54132-fd46-41ea-9d55-ffbdcad49e46 None None] Enqueued Resource ID: 57f0f6c1-7dc0-4c42-b5af-c381a47701a1 with Priority: HIGHEST for action port [ 603.743345] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f0f6c1-7dc0-4c42-b5af-c381a47701a1 with Priority: HIGHEST for action port [ 603.743667] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-57f0f6c1-7dc0-4c42-b5af-c381a47701a1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.743794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57f0f6c1-7dc0-4c42-b5af-c381a47701a1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.743863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57f0f6c1-7dc0-4c42-b5af-c381a47701a1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.744197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57f0f6c1-7dc0-4c42-b5af-c381a47701a1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.744272] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f0f6c1-7dc0-4c42-b5af-c381a47701a1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.815325] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.815491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.815562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.815756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.815862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.816105] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.816309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.816309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.816518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.816518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.816518] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e already deleted. [ 603.816598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.944725] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.944725] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.944725] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.945595] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.946148] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.946355] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.946481] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.946718] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.946869] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.947123] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.947245] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.947348] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.947460] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.947561] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.947673] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.947855] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.968791] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.968980] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.969121] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.969316] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.969646] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.969834] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.970587] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.970946] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.971446] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f7b4d5-5125-4c9f-8d33-941e723c7dd3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.048439] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.048439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.048439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.048644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.048766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.048821] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 already deleted. [ 604.049246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.110622] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.110771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.110771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.110953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.111146] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.111253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.111459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.111504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.111671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.111671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.112324] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.112324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.112324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.112324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.112324] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.112324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.112324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.112688] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.112688] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.112688] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.112776] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.154843] env[65788]: INFO networking_nsxv3.common.synchronization [None req-cc53a61d-8f76-4ffb-a816-7ee04b413d90 None None] Enqueued Resource ID: 06732b04-ec97-424c-a406-729f862138ec with Priority: HIGHEST for action port [ 604.155438] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06732b04-ec97-424c-a406-729f862138ec with Priority: HIGHEST for action port [ 604.155817] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-06732b04-ec97-424c-a406-729f862138ec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.155928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06732b04-ec97-424c-a406-729f862138ec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.155928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06732b04-ec97-424c-a406-729f862138ec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.156196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06732b04-ec97-424c-a406-729f862138ec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.156279] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06732b04-ec97-424c-a406-729f862138ec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.250085] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57f0f6c1-7dc0-4c42-b5af-c381a47701a1 [ 604.251677] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.251677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.251677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.251677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.251677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.251677] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57f0f6c1-7dc0-4c42-b5af-c381a47701a1 already deleted. [ 604.251677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57f0f6c1-7dc0-4c42-b5af-c381a47701a1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.478218] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.478218] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 72f7b4d5-5125-4c9f-8d33-941e723c7dd3 not found, creating... [ 604.478218] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.478218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.478720] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.478953] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.478953] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.479191] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.480696] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.480696] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 72f7b4d5-5125-4c9f-8d33-941e723c7dd3 is going to be created. [ 604.506209] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.506480] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.506875] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.507065] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.507371] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.507732] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.621560] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4798ea04-8c6d-401c-8b54-65632bb263de: rpc.has_security_group_logging(os_id): False [ 604.658074] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.658256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.658309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.658770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.658770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.658836] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.658885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.659320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.659320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.659468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.659837] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.659919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.659919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.661025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.661025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.661205] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.661341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.661374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.662407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.662407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.662407] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be created. [ 604.663013] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06732b04-ec97-424c-a406-729f862138ec [ 604.663215] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.663294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.663332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.664464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.664464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.664464] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06732b04-ec97-424c-a406-729f862138ec already deleted. [ 604.664464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06732b04-ec97-424c-a406-729f862138ec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.741940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.741940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.741940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.741940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.741940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.758714] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: IN_PROGRESS for 2s [ 604.834105] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 900e89d4-a148-4692-80f4-3bd065e8007a in Status: SUCCESS [ 604.835009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.306274] env[65788]: INFO networking_nsxv3.common.synchronization [req-86b718c1-923c-43fd-b276-2afedd5a9c51 req-27f799f7-98fe-4fbc-892b-8ced5e15e8c0 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 605.306274] env[65788]: INFO networking_nsxv3.common.synchronization [req-86b718c1-923c-43fd-b276-2afedd5a9c51 req-27f799f7-98fe-4fbc-892b-8ced5e15e8c0 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 605.306274] env[65788]: INFO networking_nsxv3.common.synchronization [req-86b718c1-923c-43fd-b276-2afedd5a9c51 req-27f799f7-98fe-4fbc-892b-8ced5e15e8c0 service nova] Enqueued Resource ID: 72f7b4d5-5125-4c9f-8d33-941e723c7dd3 with Priority: HIGHEST for action port [ 605.306274] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 605.306274] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 605.306274] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f7b4d5-5125-4c9f-8d33-941e723c7dd3 with Priority: HIGHEST for action port [ 605.306274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.306274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.306274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.307425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.310118] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.310118] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.310226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.310333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.310463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.310615] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.310709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.310769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.310914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.311023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.311123] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.311906] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.314349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.316329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.316554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.316680] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f7b4d5-5125-4c9f-8d33-941e723c7dd3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.819255] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.819558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.819639] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.820788] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72f7b4d5-5125-4c9f-8d33-941e723c7dd3 with status ACTIVE [ 605.821385] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.821385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.821385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.821600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.821704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.821905] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.823278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.823278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.823278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.823278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.823278] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.823529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.823529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.823678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.825391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.825391] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72f7b4d5-5125-4c9f-8d33-941e723c7dd3 is going to be updated. [ 605.848145] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.848320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.848407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.848630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.848766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.848923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f7b4d5-5125-4c9f-8d33-941e723c7dd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.326809] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.596034] env[65788]: INFO networking_nsxv3.common.synchronization [req-dd77da65-5ca3-44b1-98e8-e5c07b0c385f req-da0b3abe-e195-4cce-86f7-5d840ec8cbc7 tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 606.597013] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 606.597180] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.598400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.759885] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f8596b74-3178-434d-94e3-4c9db9fc2115 None None] Enqueued Resource ID: f7562952-a0c2-4fb0-a841-8f6e72316eb3 with Priority: HIGHEST for action port [ 606.761615] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7562952-a0c2-4fb0-a841-8f6e72316eb3 with Priority: HIGHEST for action port [ 606.762062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7562952-a0c2-4fb0-a841-8f6e72316eb3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.762218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7562952-a0c2-4fb0-a841-8f6e72316eb3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.762297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7562952-a0c2-4fb0-a841-8f6e72316eb3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.762612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7562952-a0c2-4fb0-a841-8f6e72316eb3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.762714] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7562952-a0c2-4fb0-a841-8f6e72316eb3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.779438] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: SUCCESS [ 606.779438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.830091] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.830497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.830497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.830676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.830767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.830871] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be created. [ 606.864627] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.864868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.864868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.865085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.865483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.879423] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: UNINITIALIZED for 2s [ 607.030506] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.030920] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.030920] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.031160] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.031421] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.033390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.033390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.033390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.033572] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.033672] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.033789] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.033866] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.033974] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.034103] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.034183] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.034313] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.058360] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.058519] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.058654] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.058960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.059140] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-14db4802-a246-46bd-bce8-3e67d51c9981 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.059382] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.059445] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.059826] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.059895] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14db4802-a246-46bd-bce8-3e67d51c9981',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.266807] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7562952-a0c2-4fb0-a841-8f6e72316eb3 [ 607.267133] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.267275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.267883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.267883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.267883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.267883] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7562952-a0c2-4fb0-a841-8f6e72316eb3 already deleted. [ 607.267883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7562952-a0c2-4fb0-a841-8f6e72316eb3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.562897] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.563155] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.563280] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.563520] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.563660] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.563807] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 14db4802-a246-46bd-bce8-3e67d51c9981 not found, creating... [ 607.564085] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.564278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.564426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.564653] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.564781] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.565083] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.565280] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.565390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.565623] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.565756] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.565891] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 14db4802-a246-46bd-bce8-3e67d51c9981 is going to be created. [ 607.587128] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.587356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.587473] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.587734] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.588062] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.588298] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.364763] env[65788]: INFO networking_nsxv3.common.synchronization [req-dd77da65-5ca3-44b1-98e8-e5c07b0c385f req-64dd376e-1d70-40b7-ad0e-a44329a30046 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 608.365066] env[65788]: INFO networking_nsxv3.common.synchronization [req-dd77da65-5ca3-44b1-98e8-e5c07b0c385f req-64dd376e-1d70-40b7-ad0e-a44329a30046 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 608.365225] env[65788]: INFO networking_nsxv3.common.synchronization [req-dd77da65-5ca3-44b1-98e8-e5c07b0c385f req-64dd376e-1d70-40b7-ad0e-a44329a30046 service nova] Enqueued Resource ID: 14db4802-a246-46bd-bce8-3e67d51c9981 with Priority: HIGHEST for action port [ 608.365801] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 608.366169] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 608.366293] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14db4802-a246-46bd-bce8-3e67d51c9981 with Priority: HIGHEST for action port [ 608.366582] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.366690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.366884] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.367080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.367170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-14db4802-a246-46bd-bce8-3e67d51c9981 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.367282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.367333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.367571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.367640] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14db4802-a246-46bd-bce8-3e67d51c9981',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.872467] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14db4802-a246-46bd-bce8-3e67d51c9981 with status ACTIVE [ 608.872720] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.872914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.873040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.873354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.874605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.874605] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.874605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.874605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.874605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.874605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.874987] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.874987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.874987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.875815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.875941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.876142] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14db4802-a246-46bd-bce8-3e67d51c9981 is going to be updated. [ 608.904543] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.904752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.904824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.905051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.905194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.905361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14db4802-a246-46bd-bce8-3e67d51c9981" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.911287] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 608.911551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.911717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.911920] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.912150] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.912276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.912410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.912537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.912619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.912748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.912858] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.913768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.913968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.914150] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.914258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.914317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.914467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.914548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.914648] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.414160] env[65788]: INFO networking_nsxv3.common.synchronization [None req-aa2785f1-06f0-4e38-8159-bd47be4ae03e None None] Enqueued Resource ID: 29e5a79e-61d6-4d2b-ac16-3121588db1c2 with Priority: HIGHEST for action port [ 609.414669] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e5a79e-61d6-4d2b-ac16-3121588db1c2 with Priority: HIGHEST for action port [ 609.415267] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-29e5a79e-61d6-4d2b-ac16-3121588db1c2 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.416215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29e5a79e-61d6-4d2b-ac16-3121588db1c2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.416290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29e5a79e-61d6-4d2b-ac16-3121588db1c2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.416567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29e5a79e-61d6-4d2b-ac16-3121588db1c2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.416675] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e5a79e-61d6-4d2b-ac16-3121588db1c2',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.417620] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.417717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.418190] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.869674] env[65788]: INFO networking_nsxv3.common.synchronization [None req-dfe956f5-f2ec-4080-9e79-384526ca2113 None None] Enqueued Resource ID: 41fdffd2-a996-4a23-ba31-c8632cb2d651 with Priority: HIGHEST for action port [ 609.871845] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41fdffd2-a996-4a23-ba31-c8632cb2d651 with Priority: HIGHEST for action port [ 609.873035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-41fdffd2-a996-4a23-ba31-c8632cb2d651 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.873035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41fdffd2-a996-4a23-ba31-c8632cb2d651" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.873035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41fdffd2-a996-4a23-ba31-c8632cb2d651" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.874099] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41fdffd2-a996-4a23-ba31-c8632cb2d651" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.874453] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fdffd2-a996-4a23-ba31-c8632cb2d651',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.920740] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.922185] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29e5a79e-61d6-4d2b-ac16-3121588db1c2 [ 609.922436] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.922518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.922518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.924051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.924051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.924051] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29e5a79e-61d6-4d2b-ac16-3121588db1c2 already deleted. [ 609.924051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29e5a79e-61d6-4d2b-ac16-3121588db1c2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.380051] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41fdffd2-a996-4a23-ba31-c8632cb2d651 [ 610.380356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.380505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.380578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.381022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.381136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.381237] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41fdffd2-a996-4a23-ba31-c8632cb2d651 already deleted. [ 610.381319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41fdffd2-a996-4a23-ba31-c8632cb2d651" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.424754] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.427430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.427430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.427430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.427430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.427430] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 610.458937] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.459125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.459183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.462870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.462870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.474497] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 611.615551] env[65788]: INFO networking_nsxv3.common.synchronization [req-fe505375-e9c6-4a22-8e4f-18552123b9c1 req-99682aff-9e1a-41d4-b37c-50aa4ee71066 tempest-MigrationsAdminTest-390226756 tempest-MigrationsAdminTest-390226756-project-member] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 611.616579] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 611.616579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.616579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.617684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.618094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.618273] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.618370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.618446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.618761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.619414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.619414] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.120935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.121150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.121232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.121632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.121632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.121706] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.121798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.121843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.122465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.125483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.125656] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 already deleted. [ 612.125915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.177302] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.177507] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.178231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.178231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.178351] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.178425] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.178506] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.178721] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.178913] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.179213] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.179322] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.179420] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.179515] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.179699] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.179699] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.180331] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.199869] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.201946] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.201946] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.201946] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.201946] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-226c3276-0841-406e-bdcc-ae115ff04629 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.201946] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.201946] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.201946] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.201946] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226c3276-0841-406e-bdcc-ae115ff04629',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.272547] env[65788]: INFO networking_nsxv3.common.synchronization [None req-5e92fde9-0c3a-4f1c-9f5b-f5bf16ce2259 None None] Enqueued Resource ID: 28e78f08-c976-4578-9746-0ae246f2862e with Priority: HIGHEST for action port [ 612.272784] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e78f08-c976-4578-9746-0ae246f2862e with Priority: HIGHEST for action port [ 612.273559] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-28e78f08-c976-4578-9746-0ae246f2862e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.273559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28e78f08-c976-4578-9746-0ae246f2862e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.273559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28e78f08-c976-4578-9746-0ae246f2862e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.273824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28e78f08-c976-4578-9746-0ae246f2862e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.273891] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28e78f08-c976-4578-9746-0ae246f2862e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.486489] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 612.486585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.487425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.487954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.488521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.488521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.488647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.488998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.489120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.489231] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.705391] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.705814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.705814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.706271] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.706323] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.706567] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 226c3276-0841-406e-bdcc-ae115ff04629 not found, creating... [ 612.706977] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.707238] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.707396] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.707682] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.707886] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.708310] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.708558] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.708723] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.709064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.709269] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.709803] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 226c3276-0841-406e-bdcc-ae115ff04629 is going to be created. [ 612.735286] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.736356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.736356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.736356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.736356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.737401] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.777225] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28e78f08-c976-4578-9746-0ae246f2862e [ 612.777575] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.777965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.778173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.778579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.778767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.779098] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28e78f08-c976-4578-9746-0ae246f2862e already deleted. [ 612.779098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28e78f08-c976-4578-9746-0ae246f2862e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.991900] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.285850] env[65788]: INFO networking_nsxv3.common.synchronization [None req-bb1e2e1a-aa10-4d48-91af-86db2c9bc691 None None] Enqueued Resource ID: 0fef71df-edb2-4fe5-85cb-9b18ead552ef with Priority: HIGHEST for action port [ 613.286213] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fef71df-edb2-4fe5-85cb-9b18ead552ef with Priority: HIGHEST for action port [ 613.286370] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fef71df-edb2-4fe5-85cb-9b18ead552ef taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.286496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fef71df-edb2-4fe5-85cb-9b18ead552ef" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.286563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fef71df-edb2-4fe5-85cb-9b18ead552ef" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.286843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fef71df-edb2-4fe5-85cb-9b18ead552ef" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.286921] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fef71df-edb2-4fe5-85cb-9b18ead552ef',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.440927] env[65788]: INFO networking_nsxv3.common.synchronization [req-fe505375-e9c6-4a22-8e4f-18552123b9c1 req-8148cc80-d205-4316-b428-8c688d26b897 service nova] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_rules [ 613.440927] env[65788]: INFO networking_nsxv3.common.synchronization [req-fe505375-e9c6-4a22-8e4f-18552123b9c1 req-8148cc80-d205-4316-b428-8c688d26b897 service nova] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 613.441148] env[65788]: INFO networking_nsxv3.common.synchronization [req-fe505375-e9c6-4a22-8e4f-18552123b9c1 req-8148cc80-d205-4316-b428-8c688d26b897 service nova] Enqueued Resource ID: 226c3276-0841-406e-bdcc-ae115ff04629 with Priority: HIGHEST for action port [ 613.441606] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_rules [ 613.441774] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 613.441834] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 226c3276-0841-406e-bdcc-ae115ff04629 with Priority: HIGHEST for action port [ 613.442120] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.442246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.442314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.442815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.443096] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.443791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.443904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.443975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.444166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.444315] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.444412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.444476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.444616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.444690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.444801] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.445545] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-226c3276-0841-406e-bdcc-ae115ff04629 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.445655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.445722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.445873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.445947] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226c3276-0841-406e-bdcc-ae115ff04629',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.494961] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.793030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fef71df-edb2-4fe5-85cb-9b18ead552ef [ 613.793030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.793030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.793030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.793030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.793030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.793030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fef71df-edb2-4fe5-85cb-9b18ead552ef already deleted. [ 613.793030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fef71df-edb2-4fe5-85cb-9b18ead552ef" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.948254] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.948254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.951221] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 226c3276-0841-406e-bdcc-ae115ff04629 with status ACTIVE [ 613.951499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.951645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.951711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.951930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.952035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.952240] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.952337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.952395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.952546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.952616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.952791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.952883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.952942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.953104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.953186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.953271] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 226c3276-0841-406e-bdcc-ae115ff04629 is going to be updated. [ 613.956415] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.982688] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.982897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.982897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.983137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.983387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.983451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-226c3276-0841-406e-bdcc-ae115ff04629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.998363] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.998599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.998599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.998805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.998892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.998990] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 614.050411] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.050411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.050411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.050411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.050411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.060666] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 614.130314] env[65788]: INFO networking_nsxv3.common.synchronization [req-9ca41c4a-1f58-4bfb-9bdb-3e12a7162404 req-1b9b02ec-250b-448a-8781-8501b0b4f2ce tempest-AttachInterfacesV270Test-1097869133 tempest-AttachInterfacesV270Test-1097869133-project-member] Enqueued Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_members [ 614.130314] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_members [ 614.130314] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.130314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.130314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.136219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.136219] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.136219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.136219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.136219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.136219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.136219] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.459378] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.510038] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.510038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-472" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.510038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-472" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.510038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-472" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.510038] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.510038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.510038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.510953] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.511348] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.511773] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.512169] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.514803] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.514803] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.514803] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.514803] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.514803] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.527732] env[65788]: INFO networking_nsxv3.common.synchronization [None req-bb4dddbb-21ab-49d2-94d6-33096d00c7d3 None None] Enqueued Resource ID: e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9 with Priority: HIGHEST for action port [ 614.528178] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9 with Priority: HIGHEST for action port [ 614.528508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.528647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.528711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.528953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.529435] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.537628] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.537628] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.537792] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.538318] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-472" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.538974] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.538974] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.538974] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.540165] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.540165] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.641412] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.641684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.641684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.641901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.642032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.642208] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.642309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.642393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.642556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.642633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.642719] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 already deleted. [ 614.642804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.964571] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.964913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.964913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.965056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.965093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.965230] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be created. [ 614.987931] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.988139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.988220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.988917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.988917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.998626] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: UNINITIALIZED for 2s [ 615.033126] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9 [ 615.033364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.033519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.033598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.033798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.033881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.035545] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9 already deleted. [ 615.035545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1d6e41f-3d56-45ae-a1b6-5d241ffa49f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.042270] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.042474] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.042684] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.042869] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.043977] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.044169] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 not found, creating... [ 615.044457] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.044640] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.044757] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.045212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.045212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.045508] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.045665] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.045777] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.045994] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.046137] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.046369] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 is going to be created. [ 615.069853] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.070091] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.070225] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.070533] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.070908] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.071184] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.871458] env[65788]: INFO networking_nsxv3.common.synchronization [req-9ca41c4a-1f58-4bfb-9bdb-3e12a7162404 req-ac93b586-cc81-4758-917e-de1b79263d7c service nova] Enqueued Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_rules [ 615.871623] env[65788]: INFO networking_nsxv3.common.synchronization [req-9ca41c4a-1f58-4bfb-9bdb-3e12a7162404 req-ac93b586-cc81-4758-917e-de1b79263d7c service nova] Enqueued Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_members [ 615.871756] env[65788]: INFO networking_nsxv3.common.synchronization [req-9ca41c4a-1f58-4bfb-9bdb-3e12a7162404 req-ac93b586-cc81-4758-917e-de1b79263d7c service nova] Enqueued Resource ID: b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 with Priority: HIGHEST for action port [ 615.872447] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_rules [ 615.872603] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_members [ 615.872746] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 with Priority: HIGHEST for action port [ 615.873046] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.873164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.873233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.873465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.873548] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.874469] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.874546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.874640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.874784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.874933] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.875038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.875100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.875276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.875336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.875421] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.879087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.879087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.879087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.879087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.879087] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.072425] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 616.072425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.072425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.072425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.072425] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.072425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.073198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.073198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.073198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.073198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.073198] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.074015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.074015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.074015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.074015] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.074015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.074015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.074015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.074791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.074984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.075192] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.240250] env[65788]: INFO networking_nsxv3.common.synchronization [req-400ef237-6c97-43f7-9bc8-15c6295b1cc2 req-69df53b4-d1ba-4363-ab5b-2a9c30766e7c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 616.240841] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 616.241448] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.241625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.241734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.242090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.242328] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.242501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.242616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.242853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.242992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.243164] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.379720] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.380922] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.381441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.382412] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 with status ACTIVE [ 616.382692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.383577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.383577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.383577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.384179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.385059] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.386272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.386272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.386272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.386272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.386272] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.386272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.386272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.386272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.386786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.386786] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7 is going to be updated. [ 616.415465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.415465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.415465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.415465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.415465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.415465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7edcaa4-55ca-4e76-8cee-62eeeafe9bb7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.580628] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e: rpc.has_security_group_logging(os_id): False [ 616.606494] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.606666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.607618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.607618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.607618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.607618] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.607618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.607618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.607618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.607618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.608131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.608131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.608131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.608131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.608563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.608775] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.608870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.608952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.609937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.609983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.610213] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be created. [ 616.630915] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.631738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.631738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.631945] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.636779] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.636779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.636779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.636779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.636779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.636779] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.636779] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.636779] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.636779] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.636779] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.636779] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.636779] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.659509] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.662021] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.662021] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.662021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.662021] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-5f4c0423-b73d-4822-92aa-b0df1e9c7058 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.662021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.662021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.662021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.662021] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f4c0423-b73d-4822-92aa-b0df1e9c7058',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.696210] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.697307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.697571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.698096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.698759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.716276] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 616.748277] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.748430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.749049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.749049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.749049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.749049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.749393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.749393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.749393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.749393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.749597] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 already deleted. [ 616.749597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.889016] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.010430] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 617.010700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.010870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.011108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.011311] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.011424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.011492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.011740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.011842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.011934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.012036] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.059572] env[65788]: INFO networking_nsxv3.common.synchronization [None req-69f18ae3-f992-4e26-9715-2046a664ed27 None None] Enqueued Resource ID: 7df60afa-8e20-432c-b788-7af185d3b0ea with Priority: HIGHEST for action port [ 617.060219] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7df60afa-8e20-432c-b788-7af185d3b0ea with Priority: HIGHEST for action port [ 617.060715] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7df60afa-8e20-432c-b788-7af185d3b0ea taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.061034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7df60afa-8e20-432c-b788-7af185d3b0ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.061034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7df60afa-8e20-432c-b788-7af185d3b0ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.061362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7df60afa-8e20-432c-b788-7af185d3b0ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.061456] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7df60afa-8e20-432c-b788-7af185d3b0ea',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.165738] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.165738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.165738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.165738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.165738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.165738] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 5f4c0423-b73d-4822-92aa-b0df1e9c7058 not found, creating... [ 617.165738] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.165738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.166319] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.166319] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.166319] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.166490] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.166635] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.166747] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.166951] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.167107] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.167252] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 is going to be created. [ 617.190929] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.191805] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.191805] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.192791] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.192791] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.193188] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.394460] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.394460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.394460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.394460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.394460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.394460] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 is going to be created. [ 617.420947] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.420947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.420947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.420947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.420947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.431227] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 in Status: UNINITIALIZED for 2s [ 617.514984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.515347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.515347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.515467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.516110] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.516110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.516110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.516110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.516110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.516110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.516377] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.516377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.516377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.516487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.516646] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.516738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.516795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.516930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.517944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.517944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.517944] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.565734] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7df60afa-8e20-432c-b788-7af185d3b0ea [ 617.565734] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.565734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.565734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.565734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.565990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.565990] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7df60afa-8e20-432c-b788-7af185d3b0ea already deleted. [ 617.565990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7df60afa-8e20-432c-b788-7af185d3b0ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.988660] env[65788]: INFO networking_nsxv3.common.synchronization [req-400ef237-6c97-43f7-9bc8-15c6295b1cc2 req-016ca75a-917a-47f5-8c7e-de9826bd512f service nova] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 617.988660] env[65788]: INFO networking_nsxv3.common.synchronization [req-400ef237-6c97-43f7-9bc8-15c6295b1cc2 req-016ca75a-917a-47f5-8c7e-de9826bd512f service nova] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 617.988660] env[65788]: INFO networking_nsxv3.common.synchronization [req-400ef237-6c97-43f7-9bc8-15c6295b1cc2 req-016ca75a-917a-47f5-8c7e-de9826bd512f service nova] Enqueued Resource ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with Priority: HIGHEST for action port [ 617.989582] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 617.990307] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 617.990711] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with Priority: HIGHEST for action port [ 617.991571] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.991888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.992180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.992570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.992828] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.994376] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.994641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.998089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.998089] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.998089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f4c0423-b73d-4822-92aa-b0df1e9c7058 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.998089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.998089] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f4c0423-b73d-4822-92aa-b0df1e9c7058',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.021780] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b88372-ae25-44bd-b47b-e818f59c5f00: rpc.has_security_group_logging(os_id): False [ 618.051988] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.052231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.052300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.052524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.054027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.054027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.054027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.054027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.054528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.054528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.054528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.054528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.054528] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be created. [ 618.148983] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.149199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.149264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.149496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.149673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.180903] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: IN_PROGRESS for 2s [ 618.501489] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.502534] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.502766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.503093] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with status ACTIVE [ 618.503210] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.503371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.503439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.503606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.503693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.503860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.503969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.504047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.504206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.504297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.504498] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.504595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.504659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.504860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.504860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.504955] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 is going to be updated. [ 618.530941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.531528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.532388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.532388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.532388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.532388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.600087] env[65788]: INFO networking_nsxv3.common.synchronization [req-021dd0d8-4ae4-4d53-8e72-6cad561b5f9d req-abe6b2a0-1651-481b-b5b5-7ab2e3378550 tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 618.600087] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 618.601243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.601243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.601243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.601547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.601645] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.601833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.601929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.602140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.602244] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.602358] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.746408] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 618.747863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.747863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.747863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.747863] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.003488] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.105278] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.105373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.105465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.106097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.106097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.106377] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.106523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.109027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.109027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.109027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.109027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 already deleted. [ 619.109027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.250638] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.251053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.251053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.251223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.251321] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.251434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.251493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.251654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.251738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.251827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.251915] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.398710] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.398925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.399036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.399518] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.399663] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.399879] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.399967] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.400166] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.400313] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.400521] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.400627] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.400729] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.400829] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.400927] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.401036] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.401236] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.431884] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.432200] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.432302] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.432401] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.432785] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-b52ac9fc-27db-46e8-a5f4-39820450d530 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.433031] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.433219] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.433620] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.433803] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b52ac9fc-27db-46e8-a5f4-39820450d530',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.456856] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 in Status: SUCCESS [ 619.457298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.457748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.457981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.458281] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.458414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.458494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.458695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.458785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.458880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.458979] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.506331] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.506870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.506870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.506870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.506870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.507139] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be created. [ 619.540595] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.540760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.540823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.541104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.541334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.552017] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: UNINITIALIZED for 2s [ 619.755148] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.755148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.755148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.755148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.755432] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.755432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.755432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.755600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.755600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.755695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.755830] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.756138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.756198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.756487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.756665] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.756820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.756959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.757236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.757364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.757476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.757616] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.938535] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.938879] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.939057] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.939352] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.939500] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.939681] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port b52ac9fc-27db-46e8-a5f4-39820450d530 not found, creating... [ 619.940083] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.940375] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.940529] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.940972] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.941250] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.941604] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.941774] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.941899] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.942252] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.942423] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.942579] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: b52ac9fc-27db-46e8-a5f4-39820450d530 is going to be created. [ 619.961622] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.961854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.961954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.962219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.962420] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.962571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.962656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.962844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.962944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.963065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.963247] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.963365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.963436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.963610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.963773] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.963885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.963953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.964142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.964247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.964388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.964424] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.966919] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.967145] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.967295] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.967527] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.967777] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.968033] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.203851] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 620.204128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.263349] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e: rpc.has_security_group_logging(os_id): False [ 620.285428] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.285702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.285702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.285860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.285958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.286184] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.286293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.286369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.286556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.286657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.286860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.286964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.287040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.287182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.287254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.287472] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.287557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.287630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.287755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.287821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.287909] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 620.382856] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.383109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.383109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.383359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.383538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.402717] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 620.473449] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4a3512e-9ee8-46fe-beab-4f7ada600ba3: rpc.has_security_group_logging(os_id): False [ 620.506502] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.506791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.506791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.507134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.507268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.507639] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.507805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.507888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.508361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.508472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.508764] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.508879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.508966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.509187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.510121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.510121] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.510121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.510121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.510121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.510121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.510121] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 is going to be created. [ 620.598911] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.599196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.599329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.599657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.600204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.623737] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 in Status: IN_PROGRESS for 2s [ 620.775446] env[65788]: INFO networking_nsxv3.common.synchronization [req-021dd0d8-4ae4-4d53-8e72-6cad561b5f9d req-217696ac-db05-4eaa-bf20-701991bacab1 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 620.775746] env[65788]: INFO networking_nsxv3.common.synchronization [req-021dd0d8-4ae4-4d53-8e72-6cad561b5f9d req-217696ac-db05-4eaa-bf20-701991bacab1 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 620.775979] env[65788]: INFO networking_nsxv3.common.synchronization [req-021dd0d8-4ae4-4d53-8e72-6cad561b5f9d req-217696ac-db05-4eaa-bf20-701991bacab1 service nova] Enqueued Resource ID: b52ac9fc-27db-46e8-a5f4-39820450d530 with Priority: HIGHEST for action port [ 620.777634] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 620.777845] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 620.777969] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b52ac9fc-27db-46e8-a5f4-39820450d530 with Priority: HIGHEST for action port [ 620.778333] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.778469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.778561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.778852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.779070] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.780028] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.780204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.780305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.780540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.780741] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.781386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.781386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.781386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.781386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.781386] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.784541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b52ac9fc-27db-46e8-a5f4-39820450d530 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.784541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.784541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.784541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.784541] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b52ac9fc-27db-46e8-a5f4-39820450d530',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.232169] env[65788]: INFO networking_nsxv3.common.synchronization [req-441584cc-f13e-47ec-bd7a-0211371d2aa7 req-1fc5a4db-d241-420c-b3a5-94429152cc5f tempest-DeleteServersAdminTestJSON-934681863 tempest-DeleteServersAdminTestJSON-934681863-project-admin] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 621.232169] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 621.232169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.232169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.232169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.232169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.233566] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.233815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.233988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.234311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.234502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.236030] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.287439] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.288304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.288441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.289220] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b52ac9fc-27db-46e8-a5f4-39820450d530 with status ACTIVE [ 621.289492] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.291247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.291247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.293535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.293705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.293922] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.294046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.294112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.294302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.294374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.294758] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.294758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.294758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.294930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.294930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.295174] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b52ac9fc-27db-46e8-a5f4-39820450d530 is going to be updated. [ 621.317845] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.317988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.318087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.318310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.318452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.318626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b52ac9fc-27db-46e8-a5f4-39820450d530" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.564083] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 621.564357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.564550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.564828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.564961] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.565090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.565148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.565352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.565423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.565471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.565579] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.597045] env[65788]: INFO networking_nsxv3.common.synchronization [req-a2863aa6-5bc7-4fe8-bee0-5ad88a873d08 req-0db2079d-4899-4ae5-ae7e-fd111aa5a13b tempest-VolumesAssistedSnapshotsTest-2049452914 tempest-VolumesAssistedSnapshotsTest-2049452914-project-member] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_members [ 621.597617] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_members [ 621.597950] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.601542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.601628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.601906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.602490] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.602490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.602490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.602490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.602490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.602730] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.739899] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.739899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.739899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.740334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.740381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.740602] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.740717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.740769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.740970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.741065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.741114] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be updated. [ 621.782446] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.782673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.783009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.783057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.783249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.796594] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: IN_PROGRESS for 2s [ 621.796804] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.068723] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.069251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.069251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.069458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.069652] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.069652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.069774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.070187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.070187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.070187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.070187] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.070404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.070404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.070485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.072027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.072027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.072027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.072027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.072027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.072027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.072027] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.105309] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.105538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.105538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.105901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.105901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.106065] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.106238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.106238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.106501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.106501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.106678] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 already deleted. [ 622.106752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.164374] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-217 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.164480] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-217" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.164516] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-217" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.164816] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-217" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.165090] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.165241] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.165352] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.165560] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.165694] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.165890] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.165995] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.166547] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.166618] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.166765] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.166960] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.167197] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.170366] env[65788]: INFO networking_nsxv3.common.synchronization [req-f1f0cb67-11a6-4cb3-acd4-790d932c4042 req-4263f9c4-55a7-4b08-8f4a-742f6fa62cd2 tempest-ServerDiagnosticsTest-1327084598 tempest-ServerDiagnosticsTest-1327084598-project-member] Enqueued Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_members [ 622.171344] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 900e89d4-a148-4692-80f4-3bd065e8007a with Priority: HIGHEST for action security_group_members [ 622.171750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-900e89d4-a148-4692-80f4-3bd065e8007a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.171905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.172017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.172219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.172399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.172547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.172661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.172895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.173021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.173141] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('900e89d4-a148-4692-80f4-3bd065e8007a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.189055] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.189247] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.189357] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.189531] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-217" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.189842] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-d7346317-8cbe-4c68-96be-81112ac7cded taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.190020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.190163] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.190514] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.190641] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7346317-8cbe-4c68-96be-81112ac7cded',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.300849] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.301245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.301245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.301553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.301703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.301845] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be created. [ 622.326684] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.326868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.326912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.327202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.327375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.337266] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: UNINITIALIZED for 2s [ 622.417767] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 622.418013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.574025] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7: rpc.has_security_group_logging(os_id): False [ 622.593510] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.593666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.593744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.593999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.593999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.593999] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.593999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.593999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.597168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.597168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.597168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.597168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.597168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.597168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.597168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.598981] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.598981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.598981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.598981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.598981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.598981] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be created. [ 622.645812] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 in Status: SUCCESS [ 622.646082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.667589] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.667751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.667751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.667887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.668355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.678037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.678290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.678393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.678652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.678768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.679025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.679151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.679517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.679827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.679958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.680117] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 900e89d4-a148-4692-80f4-3bd065e8007a is going to be updated. [ 622.696197] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.696466] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.696580] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.697098] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.697351] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.697512] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port d7346317-8cbe-4c68-96be-81112ac7cded not found, creating... [ 622.697958] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.698177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.698299] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.698851] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.698995] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.699726] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.699961] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.700119] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.700629] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.700966] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.701445] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: d7346317-8cbe-4c68-96be-81112ac7cded is going to be created. [ 622.706322] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 622.758951] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.759168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.759242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.759682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.759682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.764710] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.764953] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.765043] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.765348] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.765596] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.765933] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.773065] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 900e89d4-a148-4692-80f4-3bd065e8007a in Status: IN_PROGRESS for 2s [ 623.455360] env[65788]: INFO networking_nsxv3.common.synchronization [req-a2863aa6-5bc7-4fe8-bee0-5ad88a873d08 req-44e36484-62a9-4905-87d3-494a4657f872 service nova] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_rules [ 623.455594] env[65788]: INFO networking_nsxv3.common.synchronization [req-a2863aa6-5bc7-4fe8-bee0-5ad88a873d08 req-44e36484-62a9-4905-87d3-494a4657f872 service nova] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_members [ 623.455709] env[65788]: INFO networking_nsxv3.common.synchronization [req-a2863aa6-5bc7-4fe8-bee0-5ad88a873d08 req-44e36484-62a9-4905-87d3-494a4657f872 service nova] Enqueued Resource ID: d7346317-8cbe-4c68-96be-81112ac7cded with Priority: HIGHEST for action port [ 623.456856] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_rules [ 623.457358] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_members [ 623.457522] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7346317-8cbe-4c68-96be-81112ac7cded with Priority: HIGHEST for action port [ 623.458116] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.458311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.458413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.458670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.458993] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.459991] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.460129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.460214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.460417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.460585] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.460685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.460755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.460872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.460964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.462628] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.464113] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7346317-8cbe-4c68-96be-81112ac7cded taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.464233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.464299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.468023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.468023] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7346317-8cbe-4c68-96be-81112ac7cded',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.808902] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: SUCCESS [ 623.809148] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de deletion is rescheduled due to dependency. [ 623.809234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.972833] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.974204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.974410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.974759] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7346317-8cbe-4c68-96be-81112ac7cded with status ACTIVE [ 623.974990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.975172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.975234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.975437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.975579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.975692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.975784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.975859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.976061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.976175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.976460] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.976583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.976665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.976798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.976876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.977073] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7346317-8cbe-4c68-96be-81112ac7cded is going to be updated. [ 624.002120] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.002342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.002425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.002810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.003066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.003240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7346317-8cbe-4c68-96be-81112ac7cded" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.349218] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 624.349456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.349525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.349762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.349992] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.350162] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.350280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.350501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.351059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.351059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.351059] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.476376] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.723511] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 624.723903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.788096] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 900e89d4-a148-4692-80f4-3bd065e8007a in Status: SUCCESS [ 624.788096] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 900e89d4-a148-4692-80f4-3bd065e8007a deletion is rescheduled due to dependency. [ 624.788463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-900e89d4-a148-4692-80f4-3bd065e8007a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.854093] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.856369] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.856369] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.856369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.857088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.857088] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.857088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.857088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.857088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.857311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.857311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.857598] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.966013] env[65788]: INFO networking_nsxv3.common.synchronization [req-9efc5d6b-9529-44ea-9b53-aeab346a2730 req-b7d5ee7c-dba1-4b4b-9140-89e000b7b332 tempest-ServerExternalEventsTest-1270634190 tempest-ServerExternalEventsTest-1270634190-project-member] Enqueued Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_members [ 624.966756] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_members [ 624.967199] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.967324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.967414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.967737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.967941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.968101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.968181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.968376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.968490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.968619] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.980170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.980382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.980590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.982084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.982084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.982084] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 is going to be created. [ 625.010391] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.010593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.010693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.010929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.011143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.022277] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: UNINITIALIZED for 2s [ 625.367835] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482328ee-c8ae-447e-af1f-c321cd088282: rpc.has_security_group_logging(os_id): False [ 625.403850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.404014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.404104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.404473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.404603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.404874] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.405034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.405112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.405295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.405395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.405627] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.405726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.405791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.405943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.406223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.406510] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.406639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.406740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.406827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.406904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.406994] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be created. [ 625.471237] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.471489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.471567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.471788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.471881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.472118] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.472225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.472283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.472448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.472569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.472741] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 already deleted. [ 625.472813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.495460] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.495460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.495955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.496032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.496210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.508963] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 625.655580] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.655580] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.656669] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.656949] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.657275] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.657489] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.657604] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.657828] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.657961] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.658259] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.658419] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.658419] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.658544] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.658583] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.658655] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.658937] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.683087] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.683712] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.683712] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.683712] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.683901] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-50f90ce1-1b61-48a6-91dd-9f747610e540 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.684019] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.684217] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.684543] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.684672] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f90ce1-1b61-48a6-91dd-9f747610e540',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.746181] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f6a68ec2-da96-414e-9985-aad56d6862e5 tempest-ServersWithSpecificFlavorTestJSON-1851839051 tempest-ServersWithSpecificFlavorTestJSON-1851839051-project-member] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 625.747039] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 625.748607] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.748607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.748607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.748607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.748822] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.187320] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.187320] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.187320] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.187710] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.187773] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.188780] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 50f90ce1-1b61-48a6-91dd-9f747610e540 not found, creating... [ 626.188780] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.188780] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.188780] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.188780] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.188780] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.189079] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.189216] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.189326] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.189525] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.189654] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.189786] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 50f90ce1-1b61-48a6-91dd-9f747610e540 is going to be created. [ 626.211684] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.212058] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.212262] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.212595] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.212883] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.213171] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.269160] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.269320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.269402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.269617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.269708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.269816] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 already deleted. [ 626.269958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.867992] env[65788]: INFO networking_nsxv3.common.synchronization [None req-93167286-93d5-43b4-b194-73d27031c6d7 tempest-ServersWithSpecificFlavorTestJSON-1851839051 tempest-ServersWithSpecificFlavorTestJSON-1851839051-project-member] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 626.868506] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 626.868847] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.869192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.869192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.869436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.869515] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.984242] env[65788]: INFO networking_nsxv3.common.synchronization [req-9efc5d6b-9529-44ea-9b53-aeab346a2730 req-e7a004ee-6fd7-4855-8251-fea5b76d53b1 service nova] Enqueued Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_rules [ 626.984242] env[65788]: INFO networking_nsxv3.common.synchronization [req-9efc5d6b-9529-44ea-9b53-aeab346a2730 req-e7a004ee-6fd7-4855-8251-fea5b76d53b1 service nova] Enqueued Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_members [ 626.984242] env[65788]: INFO networking_nsxv3.common.synchronization [req-9efc5d6b-9529-44ea-9b53-aeab346a2730 req-e7a004ee-6fd7-4855-8251-fea5b76d53b1 service nova] Enqueued Resource ID: 50f90ce1-1b61-48a6-91dd-9f747610e540 with Priority: HIGHEST for action port [ 626.984496] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_rules [ 626.986100] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_members [ 626.986100] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f90ce1-1b61-48a6-91dd-9f747610e540 with Priority: HIGHEST for action port [ 626.986100] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.986100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.986100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.986100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.986100] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.986554] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.986554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.986554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.986900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.987079] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.989494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.989494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.989494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.989494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.989494] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.989494] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f90ce1-1b61-48a6-91dd-9f747610e540 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.989856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.989856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.989925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.990032] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f90ce1-1b61-48a6-91dd-9f747610e540',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.034259] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: SUCCESS [ 627.034556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.034705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.034920] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.035202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.035306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.035306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.035454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.035536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.035622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.035803] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.252461] env[65788]: INFO networking_nsxv3.common.synchronization [req-46fa10de-3841-4e1d-98dc-4ca797dc5f71 req-33f0d1fc-bc85-4215-a7a6-8aff5f2337e4 tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 627.252461] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 627.252461] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.252461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.252461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.252461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.252461] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.252461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.252461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.253126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.253126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.253126] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.401564] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.401564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.401564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.401564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.401564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.401564] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 already deleted. [ 627.401564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.413876] env[65788]: INFO networking_nsxv3.common.synchronization [None req-429aa5e8-8c0b-4efd-b698-c7c29824ac0b None None] Enqueued Resource ID: 22605382-f603-4ac0-bad8-ff678e85659b with Priority: HIGHEST for action port [ 627.414724] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22605382-f603-4ac0-bad8-ff678e85659b with Priority: HIGHEST for action port [ 627.415047] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-22605382-f603-4ac0-bad8-ff678e85659b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.416143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22605382-f603-4ac0-bad8-ff678e85659b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.416289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22605382-f603-4ac0-bad8-ff678e85659b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.416617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22605382-f603-4ac0-bad8-ff678e85659b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.420035] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22605382-f603-4ac0-bad8-ff678e85659b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.491461] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.495499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.495499] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50f90ce1-1b61-48a6-91dd-9f747610e540 with status ACTIVE [ 627.495499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.495499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.495499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.496975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.497224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.497589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.497589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.497709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.497709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.498431] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50f90ce1-1b61-48a6-91dd-9f747610e540 is going to be updated. [ 627.523424] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 627.523666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.531312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.531312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.531312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.531312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.531617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.531617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f90ce1-1b61-48a6-91dd-9f747610e540" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.540929] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.755668] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.755959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.756099] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.756440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.756627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.756980] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.757206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.757283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.757556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.757695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.757863] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e already deleted. [ 627.757966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.921483] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22605382-f603-4ac0-bad8-ff678e85659b [ 627.921483] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.922023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.922023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.922023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.924032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.924032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22605382-f603-4ac0-bad8-ff678e85659b already deleted. [ 627.924166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22605382-f603-4ac0-bad8-ff678e85659b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.002052] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.045345] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e376ad0-b32e-42c7-bf20-bb1704f19ac8: rpc.has_security_group_logging(os_id): False [ 628.071940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.071940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.071940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.071940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.071940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.071940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.071940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.071940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.072726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.072726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.072726] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 is going to be created. [ 628.209203] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.209445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.209583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.209822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.210076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.269965] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: IN_PROGRESS for 2s [ 628.394356] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.394625] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.394625] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.394904] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.395241] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.395436] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.395554] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.395837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.396021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.397465] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.397465] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.397465] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.397465] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.397465] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.397465] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.397465] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.431988] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.432215] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.432445] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.433417] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.433417] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-32441e40-1410-4272-83dc-53a6d6e06158 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.433417] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.433632] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.434294] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.434294] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32441e40-1410-4272-83dc-53a6d6e06158',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.504868] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.504868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.505116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.505219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.505303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.505487] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 is going to be created. [ 628.536122] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.536122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.536231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.536362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.536575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.548297] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 in Status: UNINITIALIZED for 2s [ 628.940049] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.940483] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.940483] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.940694] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.942037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.942037] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 32441e40-1410-4272-83dc-53a6d6e06158 not found, creating... [ 628.942037] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.942037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.942037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.942037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.942037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.942354] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.942354] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.942442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.942555] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.942772] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.942911] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 32441e40-1410-4272-83dc-53a6d6e06158 is going to be created. [ 628.964541] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.964541] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.964541] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.964836] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.965063] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.965278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.038192] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f672245-3b4d-4618-8d2a-8db457c74f54 req-404bf965-e54a-460e-a407-0540d1b44761 tempest-FloatingIPsAssociationNegativeTestJSON-120723859 tempest-FloatingIPsAssociationNegativeTestJSON-120723859-project-member] Enqueued Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_members [ 629.038804] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_members [ 629.039127] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40ffece-b7ec-436b-a9b9-603ca8f67c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.039257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.039372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.039651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.039771] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.039889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.039929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.040095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.040184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.040303] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.543323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.543488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.543562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.543769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.543859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.544074] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.544176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.544375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.544375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.544704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.544704] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 already deleted. [ 629.544704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.571522] env[65788]: INFO networking_nsxv3.common.synchronization [None req-19e8606b-3858-4886-95cb-9b2fe8fe988c None None] Enqueued Resource ID: 7f1186f5-5885-46a2-b003-33bd5ef284e5 with Priority: HIGHEST for action port [ 629.572101] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f1186f5-5885-46a2-b003-33bd5ef284e5 with Priority: HIGHEST for action port [ 629.572407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f1186f5-5885-46a2-b003-33bd5ef284e5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.572556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f1186f5-5885-46a2-b003-33bd5ef284e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.572632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f1186f5-5885-46a2-b003-33bd5ef284e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.572966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f1186f5-5885-46a2-b003-33bd5ef284e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.577031] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1186f5-5885-46a2-b003-33bd5ef284e5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.659360] env[65788]: INFO networking_nsxv3.common.synchronization [req-46fa10de-3841-4e1d-98dc-4ca797dc5f71 req-64361b4e-5117-40c9-a320-3d4a7292da1c service nova] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_rules [ 629.660560] env[65788]: INFO networking_nsxv3.common.synchronization [req-46fa10de-3841-4e1d-98dc-4ca797dc5f71 req-64361b4e-5117-40c9-a320-3d4a7292da1c service nova] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 629.660560] env[65788]: INFO networking_nsxv3.common.synchronization [req-46fa10de-3841-4e1d-98dc-4ca797dc5f71 req-64361b4e-5117-40c9-a320-3d4a7292da1c service nova] Enqueued Resource ID: 32441e40-1410-4272-83dc-53a6d6e06158 with Priority: HIGHEST for action port [ 629.660560] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_rules [ 629.660560] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 629.660560] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32441e40-1410-4272-83dc-53a6d6e06158 with Priority: HIGHEST for action port [ 629.660899] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.660899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.660993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.661832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.661832] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.663181] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.663313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.663389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.663575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.663943] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.664089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.666693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.666693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.666693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.666693] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.666693] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-32441e40-1410-4272-83dc-53a6d6e06158 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.666693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.666693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.666693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.666693] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32441e40-1410-4272-83dc-53a6d6e06158',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.003977] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.003977] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-898" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.003977] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-898" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.003977] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-898" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.005036] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.005036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.005036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.005036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.005275] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.005442] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.005580] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.005706] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.005816] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.005944] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.006064] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.006212] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.030564] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.032617] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.032617] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.032617] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-898" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.032617] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-843709cb-57ef-4281-bfd1-66453c0742cf taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.032617] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.032617] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.032617] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.034075] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('843709cb-57ef-4281-bfd1-66453c0742cf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.079530] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f1186f5-5885-46a2-b003-33bd5ef284e5 [ 630.079776] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.079922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.079974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.080227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.080334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.080469] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f1186f5-5885-46a2-b003-33bd5ef284e5 already deleted. [ 630.080560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f1186f5-5885-46a2-b003-33bd5ef284e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.169045] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.169045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.170778] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.172145] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32441e40-1410-4272-83dc-53a6d6e06158 with status ACTIVE [ 630.172364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.172529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.172729] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.172993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.173155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.173463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.173594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.173671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.173869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.173957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.174189] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.177787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.177787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.177787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.177787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.177787] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32441e40-1410-4272-83dc-53a6d6e06158 is going to be updated. [ 630.214662] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.215129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.215189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.216751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.216751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.216751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32441e40-1410-4272-83dc-53a6d6e06158" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.284628] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: SUCCESS [ 630.284799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.540027] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.540027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 843709cb-57ef-4281-bfd1-66453c0742cf not found, creating... [ 630.540027] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.540027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.540570] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.540570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.540570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.540570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.540570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.540570] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 843709cb-57ef-4281-bfd1-66453c0742cf is going to be created. [ 630.560326] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 in Status: SUCCESS [ 630.560579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.561063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.561063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.562749] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.562749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.562749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.562749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.562749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.562749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.562749] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.571036] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.571285] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.571507] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.571734] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.571970] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.572348] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.678554] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.064719] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.065044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.065044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.065571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.065697] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.065825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.065880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.066058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.066147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.066241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.066419] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.066530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.066597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.066740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.066878] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.066969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.067074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.067223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.067300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.067388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.067479] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.089429] env[65788]: INFO networking_nsxv3.common.synchronization [None req-a26f62cc-87f6-4e1a-8e6b-42af3edf9799 None None] Enqueued Resource ID: 3ed03461-144a-4745-b0ad-0ad3af9d5224 with Priority: HIGHEST for action port [ 631.089933] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed03461-144a-4745-b0ad-0ad3af9d5224 with Priority: HIGHEST for action port [ 631.090253] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed03461-144a-4745-b0ad-0ad3af9d5224 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.090393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed03461-144a-4745-b0ad-0ad3af9d5224" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.090468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed03461-144a-4745-b0ad-0ad3af9d5224" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.090724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed03461-144a-4745-b0ad-0ad3af9d5224" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.090810] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed03461-144a-4745-b0ad-0ad3af9d5224',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.180840] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.181260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.181461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.181720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.181836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.181962] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be created. [ 631.209805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.209953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.210036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.210348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.210474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.221599] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: UNINITIALIZED for 2s [ 631.247323] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f672245-3b4d-4618-8d2a-8db457c74f54 req-6a79d345-73b6-462f-89a4-25d3d62ca4a6 service nova] Enqueued Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_rules [ 631.247323] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f672245-3b4d-4618-8d2a-8db457c74f54 req-6a79d345-73b6-462f-89a4-25d3d62ca4a6 service nova] Enqueued Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_members [ 631.247323] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f672245-3b4d-4618-8d2a-8db457c74f54 req-6a79d345-73b6-462f-89a4-25d3d62ca4a6 service nova] Enqueued Resource ID: 843709cb-57ef-4281-bfd1-66453c0742cf with Priority: HIGHEST for action port [ 631.247457] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_rules [ 631.247548] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_members [ 631.247654] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843709cb-57ef-4281-bfd1-66453c0742cf with Priority: HIGHEST for action port [ 631.248731] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a40ffece-b7ec-436b-a9b9-603ca8f67c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.248898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.248994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.249304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.249467] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.253220] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40ffece-b7ec-436b-a9b9-603ca8f67c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.253362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.253439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.253641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.253805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.253903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.253967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.254127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.254212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.254311] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.255659] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-843709cb-57ef-4281-bfd1-66453c0742cf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.259112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.259212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.259441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.259551] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('843709cb-57ef-4281-bfd1-66453c0742cf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.572323] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe91907a-63e4-4a8f-9178-4a55cb787f15: rpc.has_security_group_logging(os_id): False [ 631.592162] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.592320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.592389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.592613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.592705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.592923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.593034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.593096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.594357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.594357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.594357] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.594357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.594357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.594357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.594357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.594357] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.594701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.594751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.595145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.595247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.595354] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 is going to be created. [ 631.596857] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ed03461-144a-4745-b0ad-0ad3af9d5224 [ 631.597036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.597140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.597205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.597356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.597431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.597513] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ed03461-144a-4745-b0ad-0ad3af9d5224 already deleted. [ 631.597590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed03461-144a-4745-b0ad-0ad3af9d5224" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.719305] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.719305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.719305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.719305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.719305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.736482] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 in Status: IN_PROGRESS for 2s [ 631.764086] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.764086] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40ffece-b7ec-436b-a9b9-603ca8f67c90 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.764086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.764086] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 843709cb-57ef-4281-bfd1-66453c0742cf with status ACTIVE [ 631.764086] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.764086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.764086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.764623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.764623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.764623] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.764764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.764764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.764916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.767143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.767820] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.767957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.768085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.768545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.768545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.768545] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 843709cb-57ef-4281-bfd1-66453c0742cf is going to be updated. [ 631.807287] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.807498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.807498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.807718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.807831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.807966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-843709cb-57ef-4281-bfd1-66453c0742cf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.272237] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.780509] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.780509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.780509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.780509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.780509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.780509] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 is going to be created. [ 632.819259] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.819413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.819485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.819703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.819883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.834039] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 in Status: UNINITIALIZED for 2s [ 633.237819] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.239696] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.239696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.239696] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.742464] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.742464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.742464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.743150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.743150] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.743150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.743150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.743292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.743292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.743372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.743835] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.743835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.743835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.743835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.745178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.745178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.745178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.745178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.745178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.745178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.745178] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.759592] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 in Status: SUCCESS [ 633.759752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.989235] env[65788]: INFO networking_nsxv3.common.synchronization [None req-29e86262-c1a1-49ce-8cef-dd63e6c33fb2 None None] Enqueued Resource ID: 0fb97769-e689-4e84-bcda-fd26380c3759 with Priority: HIGHEST for action port [ 633.989235] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fb97769-e689-4e84-bcda-fd26380c3759 with Priority: HIGHEST for action port [ 633.990054] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fb97769-e689-4e84-bcda-fd26380c3759 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.990591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fb97769-e689-4e84-bcda-fd26380c3759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.991068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fb97769-e689-4e84-bcda-fd26380c3759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.991219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fb97769-e689-4e84-bcda-fd26380c3759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.991672] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fb97769-e689-4e84-bcda-fd26380c3759',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.249056] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 312ecf31-d6a5-4636-8de5-71be8f37e76e: rpc.has_security_group_logging(os_id): False [ 634.267391] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.267552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.267552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.267875] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.267875] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.268022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.268103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.268177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.268346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.268437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.268608] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.268694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.268800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.269111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.269111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.269248] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.269248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.269363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.269422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.269505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.269581] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be created. [ 634.334643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.334813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.334851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.335217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.335453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.354346] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 634.493855] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fb97769-e689-4e84-bcda-fd26380c3759 [ 634.494108] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.494251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.494325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.494654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.494654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.494796] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fb97769-e689-4e84-bcda-fd26380c3759 already deleted. [ 634.494852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fb97769-e689-4e84-bcda-fd26380c3759" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.846346] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 in Status: SUCCESS [ 634.846346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.846753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.846753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.847824] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.847824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.847824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.847824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.847824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.847824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.847824] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.353566] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40ffece-b7ec-436b-a9b9-603ca8f67c90 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.353782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.353881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.354168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.354366] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.354489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.354538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.354713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.354802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.354895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.355067] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40ffece-b7ec-436b-a9b9-603ca8f67c90 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.355170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.355231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.355435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.355517] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.355638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.355695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.355880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.355973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.356071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.356166] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.860585] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a40ffece-b7ec-436b-a9b9-603ca8f67c90: rpc.has_security_group_logging(os_id): False [ 635.881076] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.881076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.881076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.881076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.881076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.881076] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.881076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.881558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.881558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.881558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.881677] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.882135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.882135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.882135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.882135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.882329] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.883598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.883598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.883598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.883598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.883598] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 is going to be created. [ 635.976287] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.976287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.976287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.976287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.976287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.992853] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 in Status: IN_PROGRESS for 2s [ 636.378925] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 636.379226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.521562] env[65788]: INFO networking_nsxv3.common.synchronization [None req-8c2f02ce-c351-4481-9943-3b4f1cc83483 None None] Enqueued Resource ID: 51c6a516-d54c-494f-99ca-802393117677 with Priority: HIGHEST for action port [ 636.522232] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51c6a516-d54c-494f-99ca-802393117677 with Priority: HIGHEST for action port [ 636.522477] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-51c6a516-d54c-494f-99ca-802393117677 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.522638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51c6a516-d54c-494f-99ca-802393117677" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.522712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51c6a516-d54c-494f-99ca-802393117677" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.522957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51c6a516-d54c-494f-99ca-802393117677" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.524699] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51c6a516-d54c-494f-99ca-802393117677',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.026811] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51c6a516-d54c-494f-99ca-802393117677 [ 637.027058] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.027166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.027254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.028378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.028378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.028561] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51c6a516-d54c-494f-99ca-802393117677 already deleted. [ 637.030420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51c6a516-d54c-494f-99ca-802393117677" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.007942] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 in Status: SUCCESS [ 638.008274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.951409] env[65788]: INFO networking_nsxv3.common.synchronization [None req-1aeee497-2e17-4d40-b2ed-52532c85b67e None None] Enqueued Resource ID: bf02dd64-0699-43e0-b84c-a45f76ac59a6 with Priority: HIGHEST for action port [ 638.951409] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf02dd64-0699-43e0-b84c-a45f76ac59a6 with Priority: HIGHEST for action port [ 638.953503] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf02dd64-0699-43e0-b84c-a45f76ac59a6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.953503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf02dd64-0699-43e0-b84c-a45f76ac59a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.953503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf02dd64-0699-43e0-b84c-a45f76ac59a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.954751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf02dd64-0699-43e0-b84c-a45f76ac59a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.954871] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf02dd64-0699-43e0-b84c-a45f76ac59a6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.975831] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3db95589-445c-4bef-ae39-dd9a16f5fe38 None None] Enqueued Resource ID: 5807a9cd-0cfa-41d2-860f-408729c22b82 with Priority: HIGHEST for action port [ 638.976436] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5807a9cd-0cfa-41d2-860f-408729c22b82 with Priority: HIGHEST for action port [ 638.976870] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5807a9cd-0cfa-41d2-860f-408729c22b82 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.977079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5807a9cd-0cfa-41d2-860f-408729c22b82" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.977245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5807a9cd-0cfa-41d2-860f-408729c22b82" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.977624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5807a9cd-0cfa-41d2-860f-408729c22b82" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.977624] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5807a9cd-0cfa-41d2-860f-408729c22b82',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.012822] env[65788]: INFO networking_nsxv3.common.synchronization [req-bea39a0e-ad26-4752-ac01-95078f574a86 req-2d6f3a37-f31d-4158-a7f7-b1d2b0b794f7 tempest-ServersWithSpecificFlavorTestJSON-1851839051 tempest-ServersWithSpecificFlavorTestJSON-1851839051-project-member] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 639.013528] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 639.013842] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.014848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.014973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.016160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.016428] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.016929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.017054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.017318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.017473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.017619] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.460022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf02dd64-0699-43e0-b84c-a45f76ac59a6 [ 639.460022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.460022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.460022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.460022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.460022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.460022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf02dd64-0699-43e0-b84c-a45f76ac59a6 already deleted. [ 639.460022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf02dd64-0699-43e0-b84c-a45f76ac59a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.482710] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5807a9cd-0cfa-41d2-860f-408729c22b82 [ 639.483011] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.483105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.483167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.483383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.485127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.485127] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5807a9cd-0cfa-41d2-860f-408729c22b82 already deleted. [ 639.485127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5807a9cd-0cfa-41d2-860f-408729c22b82" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.520458] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.520683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.520803] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.521151] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.521440] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.521603] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.521715] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.521945] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.522162] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.522385] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.522501] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.522604] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.522729] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.522842] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.522964] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.523084] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.525212] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.525212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.525212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.525212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.525471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.525508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.525676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.525676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.525848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.525934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.526088] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 already deleted. [ 639.526165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.544022] env[65788]: INFO networking_nsxv3.common.synchronization [req-5ccdbd1f-477d-4b0f-803c-01902b01a347 req-d582236e-40b1-4206-ade8-3df7cbdd891c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 639.544022] env[65788]: INFO networking_nsxv3.common.synchronization [req-5ccdbd1f-477d-4b0f-803c-01902b01a347 req-d582236e-40b1-4206-ade8-3df7cbdd891c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 639.544022] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 639.544022] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 639.544767] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.544904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.544973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.545199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.545365] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.545470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.545537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.545685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.545770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.545973] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.547068] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.547068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.547068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.547322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.547413] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.547505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.547581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.547709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.547778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.547880] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.551595] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.551865] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.551865] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.552085] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.552373] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-71035876-9b1e-4d69-b5d7-42f2d3195935 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.553036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.553185] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.553499] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.553635] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71035876-9b1e-4d69-b5d7-42f2d3195935',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.604433] env[65788]: INFO networking_nsxv3.common.synchronization [req-5ccdbd1f-477d-4b0f-803c-01902b01a347 req-d582236e-40b1-4206-ade8-3df7cbdd891c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_rules [ 639.604433] env[65788]: INFO networking_nsxv3.common.synchronization [req-5ccdbd1f-477d-4b0f-803c-01902b01a347 req-d582236e-40b1-4206-ade8-3df7cbdd891c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 639.604709] env[65788]: INFO networking_nsxv3.common.synchronization [req-5ccdbd1f-477d-4b0f-803c-01902b01a347 req-d582236e-40b1-4206-ade8-3df7cbdd891c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 639.604709] env[65788]: INFO networking_nsxv3.common.synchronization [req-5ccdbd1f-477d-4b0f-803c-01902b01a347 req-d582236e-40b1-4206-ade8-3df7cbdd891c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 639.604870] env[65788]: INFO networking_nsxv3.common.synchronization [req-5ccdbd1f-477d-4b0f-803c-01902b01a347 req-d582236e-40b1-4206-ade8-3df7cbdd891c tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with Priority: HIGHEST for action port [ 639.605678] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_rules [ 639.605824] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 639.605942] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with Priority: HIGHEST for action port [ 639.606055] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 639.606179] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 639.607031] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.607217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.607289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.607583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.607673] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.610137] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.611532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.611718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.611825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.612012] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.612991] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f4c0423-b73d-4822-92aa-b0df1e9c7058 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.613124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.613186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.613359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.613435] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f4c0423-b73d-4822-92aa-b0df1e9c7058',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.616087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.616087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.616233] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.616393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.050664] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.052325] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.057031] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.057310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.057456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.057743] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.057996] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.058261] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 71035876-9b1e-4d69-b5d7-42f2d3195935 not found, creating... [ 640.058683] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.058990] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.059039] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.059340] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.059515] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.059944] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.060280] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.060477] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.060777] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.060965] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.061224] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 71035876-9b1e-4d69-b5d7-42f2d3195935 is going to be created. [ 640.087116] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.087338] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.088759] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.088759] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.088759] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.088759] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.118009] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.118191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.118551] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.118661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.118823] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with status ACTIVE [ 640.118997] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.119109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.119177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.119383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.119470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.119637] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.119730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.119786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.119974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.120077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.120259] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.120503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.120617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.120828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.120939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.121196] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 is going to be updated. [ 640.153157] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.153157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.153157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.153157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.153157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.156452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.554572] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.564204] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.912375] env[65788]: INFO networking_nsxv3.common.synchronization [req-bea39a0e-ad26-4752-ac01-95078f574a86 req-1e84f23d-6901-48f9-8716-a8ce2d788f2a service nova] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 640.912478] env[65788]: INFO networking_nsxv3.common.synchronization [req-bea39a0e-ad26-4752-ac01-95078f574a86 req-1e84f23d-6901-48f9-8716-a8ce2d788f2a service nova] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 640.912591] env[65788]: INFO networking_nsxv3.common.synchronization [req-bea39a0e-ad26-4752-ac01-95078f574a86 req-1e84f23d-6901-48f9-8716-a8ce2d788f2a service nova] Enqueued Resource ID: 71035876-9b1e-4d69-b5d7-42f2d3195935 with Priority: HIGHEST for action port [ 640.913904] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 640.913904] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 640.913904] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71035876-9b1e-4d69-b5d7-42f2d3195935 with Priority: HIGHEST for action port [ 640.914099] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.914212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.915364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.915364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.915364] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.915961] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.916046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.916134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.916339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.916534] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.916534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.916534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.916813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.916897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.916998] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.918218] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-71035876-9b1e-4d69-b5d7-42f2d3195935 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.918394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.918459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.918574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.919104] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71035876-9b1e-4d69-b5d7-42f2d3195935',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.059572] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.060134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.060134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.060134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.060134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.060345] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 641.067394] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.067566] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.067566] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.067772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.067863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.068128] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be created. [ 641.104323] env[65788]: INFO networking_nsxv3.common.synchronization [req-2e129ce2-588a-46e2-a777-5081c7389aa9 req-4d7fcf0a-c8bb-4f14-85bc-fe49b864f8e7 tempest-SecurityGroupRulesNegativeTestJSON-187421276 tempest-SecurityGroupRulesNegativeTestJSON-187421276-project-member] Enqueued Resource ID: 86b1fde3-fbf7-448c-9fe8-77f827203c0d with Priority: HIGHEST for action security_group_rules [ 641.104323] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b1fde3-fbf7-448c-9fe8-77f827203c0d with Priority: HIGHEST for action security_group_rules [ 641.105516] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.105845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.106047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.106373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.108090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.108090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.108337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.108337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.108682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.108831] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b1fde3-fbf7-448c-9fe8-77f827203c0d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.112071] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.112245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.112346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.112553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.112745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.124736] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 641.126690] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: UNINITIALIZED for 2s [ 641.418155] env[65788]: INFO networking_nsxv3.common.synchronization [req-baa09cc7-59df-4a95-b9bc-f840b6886c09 req-cbe786ee-3488-4057-9ff2-8b4bf28c566d tempest-ServerMetadataTestJSON-1602187725 tempest-ServerMetadataTestJSON-1602187725-project-member] Enqueued Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_members [ 641.418155] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.418155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.418155] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_members [ 641.418155] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-60331e89-d7f7-4118-84ff-3c2694ae8888 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.418155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.418155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.418155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.419027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.419371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.419571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.419947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.420334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.420654] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.424214] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.428320] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71035876-9b1e-4d69-b5d7-42f2d3195935 with status ACTIVE [ 641.428320] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.428320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.428320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.428526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.428652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.428765] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.428860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.429069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.430309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.430309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.430309] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.430309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.430309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.430309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.430309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.430309] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71035876-9b1e-4d69-b5d7-42f2d3195935 is going to be updated. [ 641.457581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.457788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.457833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.458043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.458172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.458335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71035876-9b1e-4d69-b5d7-42f2d3195935" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.659511] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.659775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.659775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.660166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.660166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.660307] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b1fde3-fbf7-448c-9fe8-77f827203c0d already deleted. [ 641.660386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.931331] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.931572] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-829" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.932094] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-829" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.932448] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-829" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.933418] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.933418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.933418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.933418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.933622] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.933691] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.933783] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.933886] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.933984] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.934100] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.934196] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.934376] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.936153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.936348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.936348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.936590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.936590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.936907] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.937049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.937166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.937323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.937404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.937494] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 already deleted. [ 641.937577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.937782] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.958115] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.959036] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.959036] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.959036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-829" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.959227] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-1a2c92db-ea68-4990-8f88-64e84daeb3f9 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.959328] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.959373] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.959923] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.959923] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a2c92db-ea68-4990-8f88-64e84daeb3f9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.440849] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.441250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.441250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.441334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.441393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.441532] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be created. [ 642.462522] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.462774] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.463190] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.463661] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.463661] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.463661] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 1a2c92db-ea68-4990-8f88-64e84daeb3f9 not found, creating... [ 642.463821] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.463907] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.464023] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.464288] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.464437] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.464877] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.465159] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.465364] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.465597] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.465749] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.465963] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 1a2c92db-ea68-4990-8f88-64e84daeb3f9 is going to be created. [ 642.481077] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.481440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.481440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.481574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.481776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.502214] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.502448] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.502542] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.502809] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.503043] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.503430] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.508330] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: UNINITIALIZED for 2s [ 642.555263] env[65788]: INFO networking_nsxv3.common.synchronization [None req-c814d590-cac3-48be-8805-527c79ca3361 None None] Enqueued Resource ID: f9dbe402-602d-41bf-9056-1ff7b822b8c0 with Priority: HIGHEST for action port [ 642.558187] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9dbe402-602d-41bf-9056-1ff7b822b8c0 with Priority: HIGHEST for action port [ 642.559030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9dbe402-602d-41bf-9056-1ff7b822b8c0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.559175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9dbe402-602d-41bf-9056-1ff7b822b8c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.559236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9dbe402-602d-41bf-9056-1ff7b822b8c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.559937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9dbe402-602d-41bf-9056-1ff7b822b8c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.559937] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9dbe402-602d-41bf-9056-1ff7b822b8c0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.064969] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9dbe402-602d-41bf-9056-1ff7b822b8c0 [ 643.065738] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.065738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.065738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.065738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.065738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.065960] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9dbe402-602d-41bf-9056-1ff7b822b8c0 already deleted. [ 643.065960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9dbe402-602d-41bf-9056-1ff7b822b8c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.138486] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: SUCCESS [ 643.138782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.139716] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 643.139923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.140139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.140454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.140699] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.140851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.140941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.141396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.141572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.141740] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.142795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.143071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.143329] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.143504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.143615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.143832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.143974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.144134] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.216415] env[65788]: INFO networking_nsxv3.common.synchronization [req-baa09cc7-59df-4a95-b9bc-f840b6886c09 req-6021e1eb-4889-4d81-ab09-1efdd7117a8c service nova] Enqueued Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_rules [ 643.216415] env[65788]: INFO networking_nsxv3.common.synchronization [req-baa09cc7-59df-4a95-b9bc-f840b6886c09 req-6021e1eb-4889-4d81-ab09-1efdd7117a8c service nova] Enqueued Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_members [ 643.216415] env[65788]: INFO networking_nsxv3.common.synchronization [req-baa09cc7-59df-4a95-b9bc-f840b6886c09 req-6021e1eb-4889-4d81-ab09-1efdd7117a8c service nova] Enqueued Resource ID: 1a2c92db-ea68-4990-8f88-64e84daeb3f9 with Priority: HIGHEST for action port [ 643.216415] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_rules [ 643.216415] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_members [ 643.216415] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2c92db-ea68-4990-8f88-64e84daeb3f9 with Priority: HIGHEST for action port [ 643.216804] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60331e89-d7f7-4118-84ff-3c2694ae8888 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.216932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.216997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.217795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.217885] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.218823] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-60331e89-d7f7-4118-84ff-3c2694ae8888 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.218930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.219043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.219192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.219346] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.219449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.219514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.219666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.219782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.219924] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.221289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a2c92db-ea68-4990-8f88-64e84daeb3f9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.221289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.221289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.221289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.221289] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a2c92db-ea68-4990-8f88-64e84daeb3f9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.646162] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.648370] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.723791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-60331e89-d7f7-4118-84ff-3c2694ae8888 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.726538] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a2c92db-ea68-4990-8f88-64e84daeb3f9 with status ACTIVE [ 643.726538] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.726538] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.726538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.727169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.727169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.727169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.727169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.727315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.727315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.727439] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a2c92db-ea68-4990-8f88-64e84daeb3f9 is going to be updated. [ 643.730735] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.781578] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.781791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.781791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.782113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.782234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.782410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a2c92db-ea68-4990-8f88-64e84daeb3f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.137728] env[65788]: INFO networking_nsxv3.common.synchronization [req-3b9d855e-1475-42ef-aaa3-c703d2e55b38 req-47ba5363-3edb-44db-aad8-ee3f147d91c6 tempest-DeleteServersAdminTestJSON-2055679758 tempest-DeleteServersAdminTestJSON-2055679758-project-member] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 644.138720] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 644.139289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.139468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.139620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.139854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.140723] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.140886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.141008] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.141218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.141348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.141520] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.150972] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.151851] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.232937] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.522038] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.522038] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.522038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.522038] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.561059] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.561322] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.561985] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.562511] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.562591] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.562876] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.562954] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.564402] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.564402] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.564402] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.564402] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.564402] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.564402] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.564402] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.564402] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.564402] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.589827] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.589988] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.590391] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.590391] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.590703] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.590896] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.591672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.591672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.591672] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.644009] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.644198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.644656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.644656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.644773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.644957] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.645112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.645206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.645412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.645520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.645643] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be updated. [ 644.658271] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.658271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.658271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.658271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.658271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.658271] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be updated. [ 644.659501] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.659501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.659501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.659668] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.659668] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.659762] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 644.686049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.686231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.686624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.686624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.686811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.688706] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.688852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.689065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.689169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.689255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.691037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.691158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.691158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.691329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.691455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.706117] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 644.706915] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: IN_PROGRESS for 2s [ 644.707562] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: IN_PROGRESS for 2s [ 644.710204] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_members [ 644.710291] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 644.710389] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 644.710987] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_members [ 644.711160] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 644.711215] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 644.711476] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-87ec6955-50bb-44ae-8df6-a268d59c67bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.711773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.711888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.712155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.712317] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.712432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.712517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.712641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.712723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.712818] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.714082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.714082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.714082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.714082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.736083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.736291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.736380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.736595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.736595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.736595] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 is going to be created. [ 644.782789] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_rules [ 644.782789] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 644.782789] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 644.782789] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 644.782789] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_rules [ 644.782789] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_members [ 644.782789] env[65788]: INFO networking_nsxv3.common.synchronization [req-15886ecb-f086-401e-a7c4-f6b40a88dd77 req-ac030622-4bfc-4364-9ca0-d780e8d8002a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with Priority: HIGHEST for action port [ 644.783483] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.783575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.783634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.784030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.784030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.785469] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_rules [ 644.785642] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 644.785758] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_members [ 644.785844] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with Priority: HIGHEST for action port [ 644.785929] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_rules [ 644.786030] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 644.786115] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 644.786405] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.786571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.786740] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.786831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.786998] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-87ec6955-50bb-44ae-8df6-a268d59c67bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.788022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.788284] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f4c0423-b73d-4822-92aa-b0df1e9c7058 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.788431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.788519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.788687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.788771] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f4c0423-b73d-4822-92aa-b0df1e9c7058',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.789778] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87ec6955-50bb-44ae-8df6-a268d59c67bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.789925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.789967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.790186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.790281] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.791373] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.791618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.791730] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.791813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.810143] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 in Status: UNINITIALIZED for 2s [ 645.030563] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.093885] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.094249] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.094249] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.094501] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.094638] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.094784] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f not found, creating... [ 645.095043] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.095215] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.095329] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.095532] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.095661] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.095928] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.096088] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.096196] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.096386] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.096511] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.096643] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f is going to be created. [ 645.117448] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.117649] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.117758] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.118084] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.118314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.118563] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.215821] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.293940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-87ec6955-50bb-44ae-8df6-a268d59c67bb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.294356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.294582] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f4c0423-b73d-4822-92aa-b0df1e9c7058 with status ACTIVE [ 645.294770] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.294888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.294955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.295189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.295277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.295451] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.295547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.295608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.295963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.296147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.296279] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.296400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.296446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.296572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.296645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.297078] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f4c0423-b73d-4822-92aa-b0df1e9c7058 is going to be updated. [ 645.321959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.322132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.322176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.322378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.322517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.322676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f4c0423-b73d-4822-92aa-b0df1e9c7058" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.532959] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 657a43cf-f5af-40a8-8da7-615eb6b41a78: rpc.has_security_group_logging(os_id): False [ 645.555022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.555022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.555022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.555022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be created. [ 645.624192] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.624192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.624192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.624192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.624373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.637442] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: IN_PROGRESS for 2s [ 645.717521] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.111296] env[65788]: INFO networking_nsxv3.common.synchronization [req-3b9d855e-1475-42ef-aaa3-c703d2e55b38 req-4f763945-7e63-4756-aa6a-ecfe79e282ed service nova] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_rules [ 646.112705] env[65788]: INFO networking_nsxv3.common.synchronization [req-3b9d855e-1475-42ef-aaa3-c703d2e55b38 req-4f763945-7e63-4756-aa6a-ecfe79e282ed service nova] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 646.112885] env[65788]: INFO networking_nsxv3.common.synchronization [req-3b9d855e-1475-42ef-aaa3-c703d2e55b38 req-4f763945-7e63-4756-aa6a-ecfe79e282ed service nova] Enqueued Resource ID: fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f with Priority: HIGHEST for action port [ 646.114190] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_rules [ 646.114476] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 646.114651] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f with Priority: HIGHEST for action port [ 646.115463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.115630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.115732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.116092] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.116216] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.117247] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.117439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.117749] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.118703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.118787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.118982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.119080] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.221327] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.221515] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.221588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.221823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.221915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.222027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb is going to be created. [ 646.248130] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.248383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.248383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.248650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.248816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.258977] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: UNINITIALIZED for 2s [ 646.623265] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.623265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.623265] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f with status ACTIVE [ 646.623492] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.623492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.623492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.624901] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.624901] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.624901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.625282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.625282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.625282] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f is going to be updated. [ 646.654556] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.655289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.655289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.655289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.655476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.655476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcb3d9ab-d0b3-4a93-a1a7-8722806bfe7f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.731994] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 646.731994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.731994] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: SUCCESS [ 646.731994] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de deletion is rescheduled due to dependency. [ 646.731994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.731994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.731994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.731994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.731994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.731994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.733021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.733021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.733021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.733021] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.734841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.735506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.735740] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.736027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.736027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.736428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.736491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.736600] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.739585] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: SUCCESS [ 646.739852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.741895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.742051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.742461] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.742739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.742739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.743924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.743924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.743924] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.744606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.745713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.745713] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.746045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.746511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.746511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.746757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.746757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.746875] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.749077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.749281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.749526] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.749768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.749768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.749967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.749967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.750139] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.821609] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 in Status: SUCCESS [ 646.822055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.822218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.822383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.822561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.822787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.822787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.823016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.823175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.823254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.823755] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.139269] env[65788]: INFO networking_nsxv3.common.synchronization [req-efe6065c-38bb-4d9a-9135-0af7087b6ea7 req-7841b8fe-c237-482b-a307-c11da7878fb6 tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 647.139960] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 647.140204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.140330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.140400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.140668] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.140982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.140982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.140982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.141628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.141760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.141890] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.241519] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.241773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.251484] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.252807] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.254141] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.254141] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.326564] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-60331e89-d7f7-4118-84ff-3c2694ae8888 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.326564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.326564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.326931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.326931] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.326931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.326931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.327278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.327278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.327278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.327478] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-60331e89-d7f7-4118-84ff-3c2694ae8888 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.327478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.327619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.327697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.327812] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.327861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.329060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.329060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.329060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.329060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.329060] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.646400] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.652463] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 647.652954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.658964] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.658964] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.658964] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.658964] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.658964] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.659621] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.659874] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.660463] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.660779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.661424] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.661963] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.662208] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.662445] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.662746] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.663080] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.663336] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.689195] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.689195] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.689195] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.689195] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.690177] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.690177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.690177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.690557] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.690824] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151c1d78-5bd4-4fdb-92a8-2e39df9ce918',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.757356] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.757356] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.757356] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 085c9b80-54e0-49d0-b6fe-47a82ba73bd6: rpc.has_security_group_logging(os_id): False [ 647.758945] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.787830] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.787830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.787830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.787830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.787830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.788195] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.788195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.788284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.789281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.789281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.789631] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be created. [ 647.833802] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60331e89-d7f7-4118-84ff-3c2694ae8888: rpc.has_security_group_logging(os_id): False [ 647.857493] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.857658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.857723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.857962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.858164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.859997] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.860172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.860270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.860368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.860527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.860735] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.861646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.861646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.861646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.861646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.861646] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.861646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.861646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.862103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.862103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.862103] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.862276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.862276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.862346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.862396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.862481] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 is going to be created. [ 647.873591] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: IN_PROGRESS for 2s [ 647.934562] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.936035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.936035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.936035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.936035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.963321] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 in Status: IN_PROGRESS for 2s [ 647.980327] env[65788]: INFO networking_nsxv3.common.synchronization [req-74952c38-b3f9-4c0d-9a29-0da190e1c331 req-4f1b6ef8-74c7-45ba-a95e-f533604fbfc6 tempest-AttachInterfacesV270Test-1097869133 tempest-AttachInterfacesV270Test-1097869133-project-member] Enqueued Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_members [ 647.982655] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGHEST for action security_group_members [ 647.991616] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.991616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.991616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.991616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.991616] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.991616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.991616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.991616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.991616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.991616] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.151498] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.194901] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.195223] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.195395] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.196275] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.196456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.196664] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 151c1d78-5bd4-4fdb-92a8-2e39df9ce918 not found, creating... [ 648.197049] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.197270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.197428] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.197729] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.197918] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.198511] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.198625] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.198785] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.199096] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.199322] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.199480] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 151c1d78-5bd4-4fdb-92a8-2e39df9ce918 is going to be created. [ 648.223712] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.224070] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.224227] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.224544] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.224827] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.225124] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.259300] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.259519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.259519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.259761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.259913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.260116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be updated. [ 648.261730] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.261900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.261982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.262248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.262371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.262494] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 648.264608] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.264753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.264901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.265166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.265251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.265347] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be updated. [ 648.281013] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: SUCCESS [ 648.281249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.281431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.281710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.281921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.282076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.282161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.282295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.282352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.282433] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.303543] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.303794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.303794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.303999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.304114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.305869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.306019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.306080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.306239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.306360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.307961] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.308089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.308157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.308407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.308589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.320399] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: IN_PROGRESS for 2s [ 648.321114] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 648.321793] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: IN_PROGRESS for 2s [ 648.494755] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.494755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.494883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.495433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.495433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.495433] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.495603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.495603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.495757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.495961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.495961] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 is going to be updated. [ 648.527408] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.527601] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.527652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.527834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.528697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.539075] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 in Status: IN_PROGRESS for 2s [ 648.659302] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.659302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.659302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.659574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.659574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.659662] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 648.693071] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.693236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.693330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.693608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.693752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.706849] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 648.786301] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.096994] env[65788]: INFO networking_nsxv3.common.synchronization [req-efe6065c-38bb-4d9a-9135-0af7087b6ea7 req-0cedc30c-2cc2-4583-9975-0d0061e508e0 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 649.097143] env[65788]: INFO networking_nsxv3.common.synchronization [req-efe6065c-38bb-4d9a-9135-0af7087b6ea7 req-0cedc30c-2cc2-4583-9975-0d0061e508e0 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 649.097230] env[65788]: INFO networking_nsxv3.common.synchronization [req-efe6065c-38bb-4d9a-9135-0af7087b6ea7 req-0cedc30c-2cc2-4583-9975-0d0061e508e0 service nova] Enqueued Resource ID: 151c1d78-5bd4-4fdb-92a8-2e39df9ce918 with Priority: HIGHEST for action port [ 649.098150] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 649.098299] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 649.098453] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151c1d78-5bd4-4fdb-92a8-2e39df9ce918 with Priority: HIGHEST for action port [ 649.098755] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.098905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.098905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.099178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.099178] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.101535] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.101626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.102180] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.102280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.102339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.102726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.102820] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151c1d78-5bd4-4fdb-92a8-2e39df9ce918',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.291367] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.389949] env[65788]: INFO networking_nsxv3.common.synchronization [req-e7cfb723-c928-4d97-9452-e2b7dee03c34 req-af87ffa9-95fb-4ea9-96b0-6ad222cb7648 tempest-SecurityGroupRulesNegativeTestJSON-187421276 tempest-SecurityGroupRulesNegativeTestJSON-187421276-project-member] Enqueued Resource ID: 86b1fde3-fbf7-448c-9fe8-77f827203c0d with Priority: HIGHEST for action security_group_rules [ 649.391166] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b1fde3-fbf7-448c-9fe8-77f827203c0d with Priority: HIGHEST for action security_group_rules [ 649.392179] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.392179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.392179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.392885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.392885] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86b1fde3-fbf7-448c-9fe8-77f827203c0d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.601597] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.601832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.609562] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 151c1d78-5bd4-4fdb-92a8-2e39df9ce918 with status ACTIVE [ 649.609753] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.609857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.609923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.610147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.610261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.610503] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.610567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.610610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.610788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.610870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.611067] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.611165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.611229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.611369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.611484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.611605] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 151c1d78-5bd4-4fdb-92a8-2e39df9ce918 is going to be updated. [ 649.642641] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.643048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.643281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.643612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.643893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.644301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-151c1d78-5bd4-4fdb-92a8-2e39df9ce918" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.796796] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.797170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.797170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.797392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.797392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.797647] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb is going to be updated. [ 649.841888] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.842080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.842134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.843472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.843472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.854917] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: IN_PROGRESS for 2s [ 649.887538] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: SUCCESS [ 649.887538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.887538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.887816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.887878] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.916236] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.916460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.916460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.917064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.917064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.917064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86b1fde3-fbf7-448c-9fe8-77f827203c0d already deleted. [ 649.917064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86b1fde3-fbf7-448c-9fe8-77f827203c0d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.975817] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 in Status: SUCCESS [ 649.976701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.335313] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: SUCCESS [ 650.335456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.335650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.335871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.336071] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.336508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.336508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.336508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.336508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.336671] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.338118] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 650.338329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.339559] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: SUCCESS [ 650.339559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.339815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.340130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.340201] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.340310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.340379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.340546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.340661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.340723] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.341741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.341856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.342791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.342791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.342791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.342791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.342791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.342791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.343209] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.390325] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.392802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.550207] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 in Status: SUCCESS [ 650.550380] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 deletion is rescheduled due to dependency. [ 650.550515] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.728033] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 650.728273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.728464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.728695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.728910] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.729057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.729120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.729285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.729366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.729477] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.845296] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.846391] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.847800] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.847978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.848681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.848971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.849387] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.849459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.849570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.850172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.852063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.852269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.852882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.853133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.853224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.853816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.854588] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.854588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.854734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.854805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.854975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.855155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.855301] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.232910] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.361023] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.361023] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.361023] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4798ea04-8c6d-401c-8b54-65632bb263de: rpc.has_security_group_logging(os_id): False [ 651.381033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.383044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.383044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.383044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.384141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.385247] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.385247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.385247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.385247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.385247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.385247] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be updated. [ 651.450020] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e590d0bb-ed24-49a7-a610-7df6f850ca9f None None] Enqueued Resource ID: dbb159b1-ed31-4b3b-8c67-62f38647a11e with Priority: HIGHEST for action port [ 651.453369] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.453369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.453369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.453369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.453369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.453369] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb159b1-ed31-4b3b-8c67-62f38647a11e with Priority: HIGHEST for action port [ 651.453643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbb159b1-ed31-4b3b-8c67-62f38647a11e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.454104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbb159b1-ed31-4b3b-8c67-62f38647a11e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.454212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbb159b1-ed31-4b3b-8c67-62f38647a11e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.454520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbb159b1-ed31-4b3b-8c67-62f38647a11e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.454795] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbb159b1-ed31-4b3b-8c67-62f38647a11e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.471366] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: IN_PROGRESS for 2s [ 651.738085] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.865110] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.865110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.865110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.865110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.865807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.865807] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 651.866659] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.866776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.866905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.867070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.867174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.867268] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be updated. [ 651.871032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: SUCCESS [ 651.871032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.871032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.871032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.871377] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.871377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.871377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.871543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.872769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.872769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.872769] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.906449] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.906684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.906684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.906873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.907049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.908851] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.908958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.909015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.910317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.911164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.923705] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: IN_PROGRESS for 2s [ 651.924624] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 651.957998] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbb159b1-ed31-4b3b-8c67-62f38647a11e [ 651.957998] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.957998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.957998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.957998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.957998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.957998] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbb159b1-ed31-4b3b-8c67-62f38647a11e already deleted. [ 651.958366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbb159b1-ed31-4b3b-8c67-62f38647a11e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.039030] env[65788]: INFO networking_nsxv3.common.synchronization [None req-9fc5431e-b617-40bc-a571-ba32eeed84e2 None None] Enqueued Resource ID: 9afd6102-346b-4fb4-9cef-736da567ad75 with Priority: HIGHEST for action port [ 652.039554] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afd6102-346b-4fb4-9cef-736da567ad75 with Priority: HIGHEST for action port [ 652.039845] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9afd6102-346b-4fb4-9cef-736da567ad75 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.039967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9afd6102-346b-4fb4-9cef-736da567ad75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.041747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9afd6102-346b-4fb4-9cef-736da567ad75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.042040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9afd6102-346b-4fb4-9cef-736da567ad75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.042131] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9afd6102-346b-4fb4-9cef-736da567ad75',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.239097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.239265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.239339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.239561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.239652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.239756] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 652.272286] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.272286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.272486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.272535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.272782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.282963] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 652.375248] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.548179] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9afd6102-346b-4fb4-9cef-736da567ad75 [ 652.548179] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.548179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.548179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.548179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.548179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.548179] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9afd6102-346b-4fb4-9cef-736da567ad75 already deleted. [ 652.548179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9afd6102-346b-4fb4-9cef-736da567ad75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.881728] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87ec6955-50bb-44ae-8df6-a268d59c67bb: rpc.has_security_group_logging(os_id): False [ 652.900462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.900462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.900690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.900744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.900831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.904018] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.904018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.904018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.904018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.904018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.904018] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb is going to be created. [ 652.959797] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.959797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.959797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.959797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.959797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.970798] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: IN_PROGRESS for 2s [ 653.486174] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: SUCCESS [ 653.486602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.936948] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 653.937248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.937444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.937721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.937868] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.938192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.938192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.938284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.938348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.938455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.938613] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.938733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.938799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.939017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.939173] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.939269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.939332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.939476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.939553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.939638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.939732] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.942606] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: SUCCESS [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.942606] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.942606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.942606] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.163070] env[65788]: INFO networking_nsxv3.common.synchronization [req-42ae383b-a0d1-4136-a98b-c1cc030e381c req-02d0b50b-1444-4d04-b69c-0300430ba3b9 tempest-TenantUsagesTestJSON-417307340 tempest-TenantUsagesTestJSON-417307340-project-member] Enqueued Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_members [ 654.163686] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_members [ 654.163998] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.164557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.164687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.164957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.165063] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.165181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.165223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.165379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.165467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.165569] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.295085] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 654.295308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.298840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.299013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.299144] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.300278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.300428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.300573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.300673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.300774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.300873] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.406585] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7bfd2d26-2543-4b1b-81a1-44802bbea78a tempest-ServersTestBootFromVolume-728581813 tempest-ServersTestBootFromVolume-728581813-project-member] Enqueued Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_rules [ 654.407401] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_rules [ 654.408010] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1723657c-045d-4e76-905a-f1602b6cbec4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.408196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.408348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.408776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.408935] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.446956] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7: rpc.has_security_group_logging(os_id): False [ 654.448163] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.471742] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.473589] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.473589] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.473589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.474496] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.474759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.474759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.474914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.474996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.475135] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 654.569436] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.569646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.569693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.569879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.570039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.590476] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 654.599717] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3c61a96a-e0da-43ac-88b5-8f7e1903705a tempest-ServersTestBootFromVolume-728581813 tempest-ServersTestBootFromVolume-728581813-project-member] Enqueued Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_rules [ 654.602379] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_rules [ 654.602379] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1723657c-045d-4e76-905a-f1602b6cbec4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.602379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.616743] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.616947] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.617114] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.617383] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.617658] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.618534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.618534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.618534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.618534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.618749] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.618812] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.618956] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.619057] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.619194] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.619323] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.619484] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.648470] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.648687] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.648843] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.650109] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.650109] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-cad5effa-2aab-458e-bf43-4b9cfa82abab taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.650109] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.650109] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.650750] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.650917] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cad5effa-2aab-458e-bf43-4b9cfa82abab',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.667651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.667651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.667870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.667925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.668052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.668213] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.668318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.668384] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.669604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.669727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.669834] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 already deleted. [ 654.671417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.803766] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.803969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.804056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.804586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.804779] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.805008] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.805115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.805811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.805811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.805811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.805811] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.805811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.806153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.806153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.806245] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.806339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.806392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.806523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.806603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.806695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.806798] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.935342] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.935843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.935988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.936283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.936423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.936585] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1723657c-045d-4e76-905a-f1602b6cbec4 already deleted. [ 654.936748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.936999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.937256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.937301] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.952073] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 085c9b80-54e0-49d0-b6fe-47a82ba73bd6: rpc.has_security_group_logging(os_id): False [ 654.976173] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.976375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.976375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.976690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.976850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.977258] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.977446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.977549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.977794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.977979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.978143] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be updated. [ 654.991667] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: SUCCESS [ 654.992030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.051401] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.051634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.051763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.052043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.052223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.068897] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: IN_PROGRESS for 2s [ 655.153551] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.153874] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.154587] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.154587] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.154587] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.155447] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port cad5effa-2aab-458e-bf43-4b9cfa82abab not found, creating... [ 655.155447] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.155447] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.155447] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.156105] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.156451] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.156669] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.156841] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.157334] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.157334] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.157501] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.157604] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: cad5effa-2aab-458e-bf43-4b9cfa82abab is going to be created. [ 655.189703] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.190050] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.190941] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.190941] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.190941] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.191182] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.310417] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e: rpc.has_security_group_logging(os_id): False [ 655.349688] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.349856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.349928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.350164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.350332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.350461] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.350681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.350727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.350929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.351012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.351886] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.351886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.351886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.351886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.351886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.354718] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.354939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.354939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.355085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.355139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.355227] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 655.460850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.461066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.461066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.462555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.462555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.476415] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.476588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.476656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.476973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.477074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.477176] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1723657c-045d-4e76-905a-f1602b6cbec4 already deleted. [ 655.477261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.479743] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 655.666117] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f3404627-93d9-45aa-862d-1ce397ac58f6 None None] Enqueued Resource ID: 49bd28c0-596e-414d-ad07-cbaecc06f629 with Priority: HIGHEST for action port [ 655.666904] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bd28c0-596e-414d-ad07-cbaecc06f629 with Priority: HIGHEST for action port [ 655.669037] env[65788]: INFO networking_nsxv3.common.synchronization [req-1676e3d7-f00d-49ae-94bb-f26747fed5bd req-9e8e192e-ea1e-4e14-af10-c8e4afa4cc2a tempest-ServerExternalEventsTest-1270634190 tempest-ServerExternalEventsTest-1270634190-project-member] Enqueued Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_members [ 655.669037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-49bd28c0-596e-414d-ad07-cbaecc06f629 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.669037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49bd28c0-596e-414d-ad07-cbaecc06f629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.669037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49bd28c0-596e-414d-ad07-cbaecc06f629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.669324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49bd28c0-596e-414d-ad07-cbaecc06f629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.669324] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bd28c0-596e-414d-ad07-cbaecc06f629',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.670864] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGHEST for action security_group_members [ 655.671440] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.673254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.673254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.673254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.673254] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.673254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.673254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.673254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.673254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.673254] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.180241] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49bd28c0-596e-414d-ad07-cbaecc06f629 [ 656.180241] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.180241] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49bd28c0-596e-414d-ad07-cbaecc06f629 already deleted. [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49bd28c0-596e-414d-ad07-cbaecc06f629" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.180241] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.180241] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.180241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.183397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.183397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.183397] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 is going to be updated. [ 656.227849] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.227849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.227849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.227849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.227849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.238370] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 in Status: IN_PROGRESS for 2s [ 656.285327] env[65788]: INFO networking_nsxv3.common.synchronization [req-42ae383b-a0d1-4136-a98b-c1cc030e381c req-64ab4e3b-57d4-4922-a619-e7c5de029eff service nova] Enqueued Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_rules [ 656.285327] env[65788]: INFO networking_nsxv3.common.synchronization [req-42ae383b-a0d1-4136-a98b-c1cc030e381c req-64ab4e3b-57d4-4922-a619-e7c5de029eff service nova] Enqueued Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_members [ 656.285327] env[65788]: INFO networking_nsxv3.common.synchronization [req-42ae383b-a0d1-4136-a98b-c1cc030e381c req-64ab4e3b-57d4-4922-a619-e7c5de029eff service nova] Enqueued Resource ID: cad5effa-2aab-458e-bf43-4b9cfa82abab with Priority: HIGHEST for action port [ 656.287266] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_rules [ 656.288832] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_members [ 656.288832] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad5effa-2aab-458e-bf43-4b9cfa82abab with Priority: HIGHEST for action port [ 656.288832] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.288832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.288832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.290841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.291404] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.293681] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.293681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.293681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.293681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.294082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.294082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.294082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.294082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.294323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.294323] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.296272] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-cad5effa-2aab-458e-bf43-4b9cfa82abab taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.296272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.296272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.296272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.300454] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cad5effa-2aab-458e-bf43-4b9cfa82abab',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.611848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 656.612081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.612597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.613605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.613605] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.804156] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.805500] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.805651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.805870] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cad5effa-2aab-458e-bf43-4b9cfa82abab with status ACTIVE [ 656.806065] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.806182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.806248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.806484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.806586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.806819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.807086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.809448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.813614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.813614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.813614] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.813614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.813614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.813614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.813614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.813614] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cad5effa-2aab-458e-bf43-4b9cfa82abab is going to be updated. [ 656.856342] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.856342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.856342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.856342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.856342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.856342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cad5effa-2aab-458e-bf43-4b9cfa82abab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.914488] env[65788]: INFO networking_nsxv3.common.synchronization [None req-dba070e0-395f-4fef-93c0-272c99c014e6 None None] Enqueued Resource ID: b24f563e-b746-4573-b565-b40dc97275ba with Priority: HIGHEST for action port [ 656.915565] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b24f563e-b746-4573-b565-b40dc97275ba with Priority: HIGHEST for action port [ 656.915933] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b24f563e-b746-4573-b565-b40dc97275ba taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.916623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b24f563e-b746-4573-b565-b40dc97275ba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.916778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b24f563e-b746-4573-b565-b40dc97275ba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.917046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b24f563e-b746-4573-b565-b40dc97275ba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.917134] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b24f563e-b746-4573-b565-b40dc97275ba',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.091318] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: SUCCESS [ 657.091391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.118971] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.119241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.119325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.119748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.119983] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.120113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.120193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.120383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.120486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.121116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.121116] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.317757] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.421274] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b24f563e-b746-4573-b565-b40dc97275ba [ 657.421839] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.423079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.423079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.423079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.423079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.423079] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b24f563e-b746-4573-b565-b40dc97275ba already deleted. [ 657.423079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b24f563e-b746-4573-b565-b40dc97275ba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.498103] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 657.499444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.626701] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.626941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.626941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.627170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.627322] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.627443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.627485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.627621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.627745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.627820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.627935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.628040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.628104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.628262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.628375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.628485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.628552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.628696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.628831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.628954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.629064] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.822589] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.822882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.822882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.823126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.823214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.823322] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 is going to be created. [ 657.859530] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.859752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.859752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.859965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.860155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.872577] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 in Status: UNINITIALIZED for 2s [ 658.131513] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7: rpc.has_security_group_logging(os_id): False [ 658.152310] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.152531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.152632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.152965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.153084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.153323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.153428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.153512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.153704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.153784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.154039] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.154155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.154242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.154397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.154477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.154747] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.154747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.154866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.154952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.155041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.155276] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 658.182548] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-9c0ff72e-433b-4666-9296-31eae6ccbd79 tempest-ListServersNegativeTestJSON-1369105691 tempest-ListServersNegativeTestJSON-1369105691-project-member] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 658.183436] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 658.183645] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.183869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.183945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.184233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.184430] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.184552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.184625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.184825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.184912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.185054] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.247766] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.247928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.248007] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.248393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.248551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.250962] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 in Status: SUCCESS [ 658.251162] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 deletion is rescheduled due to dependency. [ 658.251320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.267560] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 658.659853] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-456 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.667045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.667045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.667045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.667045] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.667045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.667045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.667045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.667045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.667490] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.667490] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.667563] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.667669] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.667885] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.667885] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.668043] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.688038] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.688353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.688353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.688938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.688938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.688938] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.688938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.688938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.689245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.689245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.689367] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 already deleted. [ 658.689401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.693849] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.694674] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.694674] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.694674] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.694872] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-55144f9a-4d8a-44d4-81b4-81d8f962f693 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.694872] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.694992] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.695343] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.695481] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55144f9a-4d8a-44d4-81b4-81d8f962f693',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.202680] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.202680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.202680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.202680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.202680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.202936] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 55144f9a-4d8a-44d4-81b4-81d8f962f693 not found, creating... [ 659.203063] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.203210] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.203315] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.203519] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.203766] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.203909] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.204063] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.204177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.204521] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.204622] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.205188] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 55144f9a-4d8a-44d4-81b4-81d8f962f693 is going to be created. [ 659.232088] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.232355] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.232475] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.232753] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.233022] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.233273] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.883799] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 in Status: SUCCESS [ 659.884444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.884867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.884867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.885170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.885170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.885436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.885436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.885560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.885795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.885795] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.002084] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-8d601ff3-3e2a-4448-af44-6296d6348e05 service nova] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_rules [ 660.002559] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-8d601ff3-3e2a-4448-af44-6296d6348e05 service nova] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 660.002559] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-8d601ff3-3e2a-4448-af44-6296d6348e05 service nova] Enqueued Resource ID: 55144f9a-4d8a-44d4-81b4-81d8f962f693 with Priority: HIGHEST for action port [ 660.003015] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_rules [ 660.003208] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 660.003320] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55144f9a-4d8a-44d4-81b4-81d8f962f693 with Priority: HIGHEST for action port [ 660.003605] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.003730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.003797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.004062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.004145] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.005233] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.005569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.005569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.005569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.005784] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.005852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.005891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.006018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.006105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.006198] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.006971] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-55144f9a-4d8a-44d4-81b4-81d8f962f693 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.007884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.007884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.007884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.007884] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55144f9a-4d8a-44d4-81b4-81d8f962f693',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.287813] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 660.287813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.389871] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.390079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.390155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.390396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.390660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.390789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.390858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.391041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.391136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.391228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.391399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.391633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.391633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.391812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.391982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.392095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.392150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.392326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.392408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.392495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.392603] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.508880] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.510788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.510935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.511126] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55144f9a-4d8a-44d4-81b4-81d8f962f693 with status ACTIVE [ 660.511280] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.511424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.511514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.511833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.511833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.512034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.512140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.512247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.512399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.512485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.512692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.512793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.512844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.513028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.513134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.513237] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55144f9a-4d8a-44d4-81b4-81d8f962f693 is going to be updated. [ 660.539788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.540078] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.540078] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.540341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.540481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.540756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55144f9a-4d8a-44d4-81b4-81d8f962f693" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.895637] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14dfde5c-711e-462d-8f85-f6fadc780c54: rpc.has_security_group_logging(os_id): False [ 660.919245] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.919506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.919506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.919694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.919766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.919983] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.920132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.920132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.920290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.920519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.920657] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.920856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.920856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.921060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.921965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.922283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.922454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.922563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.922759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.922923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.923091] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 is going to be created. [ 661.001218] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.001218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.001218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.001218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.001218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.015351] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 in Status: IN_PROGRESS for 2s [ 661.015950] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.504485] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-99f96166-9145-4d45-97ac-f5cb0e687e3e tempest-ListServersNegativeTestJSON-1369105691 tempest-ListServersNegativeTestJSON-1369105691-project-member] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 661.505438] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 661.506117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.506117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.519940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.521147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.521147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.521147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.521147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.521147] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be created. [ 661.549043] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.549228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.549322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.549553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.549726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.560180] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: UNINITIALIZED for 2s [ 662.500528] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-456 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.502198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.502198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.502198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.502198] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.502402] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.502402] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.502701] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.502917] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.503225] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.503397] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.503555] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.503718] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.504186] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.504186] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.504350] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.529062] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.530447] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.530447] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.530447] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.530447] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-56e26cb4-5731-466d-9bc4-2f1e906a6107 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.530447] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.530447] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.530447] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.530973] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e26cb4-5731-466d-9bc4-2f1e906a6107',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.029073] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 in Status: SUCCESS [ 663.029315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.033114] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.033382] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.033510] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.033754] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.033897] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.034059] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 56e26cb4-5731-466d-9bc4-2f1e906a6107 not found, creating... [ 663.034345] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.034503] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.034615] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.034856] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.034993] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.035295] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.035446] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.035576] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.035784] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.035908] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.036053] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 56e26cb4-5731-466d-9bc4-2f1e906a6107 is going to be created. [ 663.063252] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.063575] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.063789] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.064937] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.064937] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.064937] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.572578] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 663.573095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.573095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.573268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.573581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.573706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.573706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.573848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.573967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.574088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.574191] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.575188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.575411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.575667] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.575859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.575970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.576187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.577398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.577398] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.823030] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-3053364f-8f27-479f-9021-c7c9408e5366 service nova] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_rules [ 663.823030] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-3053364f-8f27-479f-9021-c7c9408e5366 service nova] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 663.823030] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-3053364f-8f27-479f-9021-c7c9408e5366 service nova] Enqueued Resource ID: 56e26cb4-5731-466d-9bc4-2f1e906a6107 with Priority: HIGHEST for action port [ 663.823030] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_rules [ 663.825554] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 663.825554] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56e26cb4-5731-466d-9bc4-2f1e906a6107 with Priority: HIGHEST for action port [ 663.825554] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.825554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.828145] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.828145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.828145] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-56e26cb4-5731-466d-9bc4-2f1e906a6107 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.828145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.828145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.828145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.828145] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e26cb4-5731-466d-9bc4-2f1e906a6107',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.078546] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.078840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.078840] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.330593] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56e26cb4-5731-466d-9bc4-2f1e906a6107 with status ACTIVE [ 664.332151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.333255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.333338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.333594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.333753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.333987] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.334138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.334205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.334379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.334764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.335750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.335860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.335923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.336600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.336855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.336958] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56e26cb4-5731-466d-9bc4-2f1e906a6107 is going to be updated. [ 664.368666] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.368666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.368666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.368666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.368666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.368666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56e26cb4-5731-466d-9bc4-2f1e906a6107" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.582639] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.918857] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-1675c8b2-8b8e-4103-81f7-265ed7f98627 tempest-ListServersNegativeTestJSON-1369105691 tempest-ListServersNegativeTestJSON-1369105691-project-member] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 664.918857] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 664.918857] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.918857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.089430] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.089701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.089852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.090253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.090480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.090573] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 665.129499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.129675] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.129725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.130330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.130330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.141278] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 665.644844] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f18cf167-8a5f-4c88-b9bf-0bd41e98353c None None] Enqueued Resource ID: 58f2a7dc-0e5d-4571-ac18-c2bd6a744d12 with Priority: HIGHEST for action port [ 665.645398] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58f2a7dc-0e5d-4571-ac18-c2bd6a744d12 with Priority: HIGHEST for action port [ 665.645791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-58f2a7dc-0e5d-4571-ac18-c2bd6a744d12 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.645963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58f2a7dc-0e5d-4571-ac18-c2bd6a744d12" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.646464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58f2a7dc-0e5d-4571-ac18-c2bd6a744d12" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.646774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58f2a7dc-0e5d-4571-ac18-c2bd6a744d12" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.647017] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f2a7dc-0e5d-4571-ac18-c2bd6a744d12',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.903738] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-456 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.905081] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.905229] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.905508] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.905787] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.905935] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.906090] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.906413] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.906472] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.907716] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.907716] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.907832] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.908171] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.908619] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.908742] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.908873] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.928746] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.928988] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.929076] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.929258] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-456" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.929563] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.929729] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.929846] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.930193] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.930329] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.149617] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58f2a7dc-0e5d-4571-ac18-c2bd6a744d12 [ 666.149867] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.150019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.150094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.150312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.150401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.150612] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58f2a7dc-0e5d-4571-ac18-c2bd6a744d12 already deleted. [ 666.150612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58f2a7dc-0e5d-4571-ac18-c2bd6a744d12" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.434054] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.434289] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.434409] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.434690] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.434841] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.434994] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 not found, creating... [ 666.435274] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.435427] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.435540] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.435880] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.436137] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.436579] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.436757] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.436873] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.437095] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.437229] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.437443] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 is going to be created. [ 666.460219] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.460445] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.460567] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.460985] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.461406] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.461547] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.154524] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 667.155054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.155054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.155619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.155619] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.157041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.157041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.157041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.157041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.157041] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.267124] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-662d72c1-6cd6-461c-a8a2-e1400398181d service nova] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_rules [ 667.267306] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-662d72c1-6cd6-461c-a8a2-e1400398181d service nova] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 667.267438] env[65788]: INFO networking_nsxv3.common.synchronization [req-b297760a-2156-4a9b-8ca1-2106240c986a req-662d72c1-6cd6-461c-a8a2-e1400398181d service nova] Enqueued Resource ID: 7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 with Priority: HIGHEST for action port [ 667.268038] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_rules [ 667.268182] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 667.268258] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 with Priority: HIGHEST for action port [ 667.268527] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.268670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.268923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.269846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.270453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.270589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.270668] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.270908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.270997] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.660193] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.764020] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ab9467a6-3cdc-45b3-9772-6454199899b2 None None] Enqueued Resource ID: b58d4698-b560-434c-8251-a69adc5414d2 with Priority: HIGHEST for action port [ 667.764618] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58d4698-b560-434c-8251-a69adc5414d2 with Priority: HIGHEST for action port [ 667.764931] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b58d4698-b560-434c-8251-a69adc5414d2 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.765083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b58d4698-b560-434c-8251-a69adc5414d2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.765143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b58d4698-b560-434c-8251-a69adc5414d2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.765381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b58d4698-b560-434c-8251-a69adc5414d2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.765481] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b58d4698-b560-434c-8251-a69adc5414d2',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.775295] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 with status ACTIVE [ 667.776080] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.776080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.776080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.776080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.776080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.776326] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.776326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.776326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.776523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.776523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.776725] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.776818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.776891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.777051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.777144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.777232] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6 is going to be updated. [ 667.959193] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.959399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.959399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.960057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.960057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.960057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7235f3b3-af0c-4bf7-8ed9-e8d146ec75c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.162452] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.268076] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b58d4698-b560-434c-8251-a69adc5414d2 [ 668.268279] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.268440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.268440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.269541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.269541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.269541] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b58d4698-b560-434c-8251-a69adc5414d2 already deleted. [ 668.269541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b58d4698-b560-434c-8251-a69adc5414d2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.479164] env[65788]: INFO networking_nsxv3.common.synchronization [req-6fc1cbc3-d3f8-46f7-b0c5-6ab44967ee65 req-89bb2913-c3b6-4b38-b6fb-153142a7b394 tempest-FloatingIPsAssociationTestJSON-899504544 tempest-FloatingIPsAssociationTestJSON-899504544-project-member] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 668.479164] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 668.479565] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.479565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.479809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.479893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.480153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.480275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.480334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.480610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.480738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.480867] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.665866] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.666346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.666444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.666640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.666723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.666830] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 668.702063] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.702606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.702606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.702953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.703148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.725863] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 668.886529] env[65788]: INFO networking_nsxv3.common.synchronization [None req-8fb6b5ed-5b81-4a7d-bee7-3202327189d4 None None] Enqueued Resource ID: 48911440-9c48-4eaa-8349-fcf48d636c1e with Priority: HIGHEST for action port [ 668.887562] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48911440-9c48-4eaa-8349-fcf48d636c1e with Priority: HIGHEST for action port [ 668.887913] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-48911440-9c48-4eaa-8349-fcf48d636c1e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.888672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48911440-9c48-4eaa-8349-fcf48d636c1e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.888672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48911440-9c48-4eaa-8349-fcf48d636c1e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.888672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48911440-9c48-4eaa-8349-fcf48d636c1e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.888926] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48911440-9c48-4eaa-8349-fcf48d636c1e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.986533] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.986952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.986952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.987877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.988017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.988296] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.988431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.988481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.988670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.988926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.988926] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 already deleted. [ 668.989018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.238187] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.238757] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.238757] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.239051] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.239339] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.239502] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.239611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.239830] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.240089] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.240260] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.240362] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.240460] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.240552] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.240677] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.240830] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.240956] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.263480] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.263690] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.263746] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.265627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.265627] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-02c9ab3e-9750-41dc-901e-6b17e600c97a taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.265627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.265627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.265627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.265627] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c9ab3e-9750-41dc-901e-6b17e600c97a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.390881] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48911440-9c48-4eaa-8349-fcf48d636c1e [ 669.391813] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.391921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.391990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.392231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.392321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.392424] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48911440-9c48-4eaa-8349-fcf48d636c1e already deleted. [ 669.392508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48911440-9c48-4eaa-8349-fcf48d636c1e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.768857] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.768857] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.768857] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.769138] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.769285] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.769489] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 02c9ab3e-9750-41dc-901e-6b17e600c97a not found, creating... [ 669.770601] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.770601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.770601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.770601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.770960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.775273] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.775612] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.775762] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.776075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.776261] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.776445] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 02c9ab3e-9750-41dc-901e-6b17e600c97a is going to be created. [ 669.804040] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.804040] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.804040] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.804372] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.804531] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.804792] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.062153] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3769dc10-b0c5-4fee-9513-cb44cb1ddca7 None None] Enqueued Resource ID: 584233a8-207f-487c-9c7e-784e1b5df5f4 with Priority: HIGHEST for action port [ 670.062289] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584233a8-207f-487c-9c7e-784e1b5df5f4 with Priority: HIGHEST for action port [ 670.063234] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-584233a8-207f-487c-9c7e-784e1b5df5f4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.063642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-584233a8-207f-487c-9c7e-784e1b5df5f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.063871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-584233a8-207f-487c-9c7e-784e1b5df5f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.064315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-584233a8-207f-487c-9c7e-784e1b5df5f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.064628] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('584233a8-207f-487c-9c7e-784e1b5df5f4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.549163] env[65788]: INFO networking_nsxv3.common.synchronization [req-6fc1cbc3-d3f8-46f7-b0c5-6ab44967ee65 req-35f2622d-547c-4ff0-9058-fe8ed952ea0e service nova] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_rules [ 670.549450] env[65788]: INFO networking_nsxv3.common.synchronization [req-6fc1cbc3-d3f8-46f7-b0c5-6ab44967ee65 req-35f2622d-547c-4ff0-9058-fe8ed952ea0e service nova] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 670.549606] env[65788]: INFO networking_nsxv3.common.synchronization [req-6fc1cbc3-d3f8-46f7-b0c5-6ab44967ee65 req-35f2622d-547c-4ff0-9058-fe8ed952ea0e service nova] Enqueued Resource ID: 02c9ab3e-9750-41dc-901e-6b17e600c97a with Priority: HIGHEST for action port [ 670.551560] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_rules [ 670.551560] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 670.551560] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c9ab3e-9750-41dc-901e-6b17e600c97a with Priority: HIGHEST for action port [ 670.551560] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.551560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.551560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.552111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.552111] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.552687] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.552815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.552876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.553762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.553762] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.553762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.553762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.554767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.554929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.555080] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.558022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-02c9ab3e-9750-41dc-901e-6b17e600c97a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.558022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.558022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.558022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.558022] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c9ab3e-9750-41dc-901e-6b17e600c97a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.570278] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 584233a8-207f-487c-9c7e-784e1b5df5f4 [ 670.570636] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.570814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.570814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.572072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.572072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.572072] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:584233a8-207f-487c-9c7e-784e1b5df5f4 already deleted. [ 670.572072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-584233a8-207f-487c-9c7e-784e1b5df5f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.750515] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 670.750742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.750933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.751178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.751371] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.751490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.751549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.751731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.751861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.751996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.752103] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.752179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.752236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.752380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.752507] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.752625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.752738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.752891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.752968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.753748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.754193] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.758232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.758232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.758232] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.758232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.758232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.758232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.758232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.758232] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.062949] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.063127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.063305] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.064200] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02c9ab3e-9750-41dc-901e-6b17e600c97a with status ACTIVE [ 671.064784] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.064944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.065035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.065257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.065331] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.065511] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.065610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.065673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.065828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.065985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.071033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.071033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.071033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.071033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.071033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.071033] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02c9ab3e-9750-41dc-901e-6b17e600c97a is going to be updated. [ 671.092347] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.092506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.092612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.092797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.092928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.093394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02c9ab3e-9750-41dc-901e-6b17e600c97a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.258797] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fca49d1-97b5-45f3-9237-0af8e319bb34: rpc.has_security_group_logging(os_id): False [ 671.261240] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.290152] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.290470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.290470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.291058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.291058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.291058] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.291058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.292096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.292096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.292096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.292096] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.292096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.292096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.292096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.292096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.294717] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.294862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.294936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.295568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.295671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.295777] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be created. [ 671.366156] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.366347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.366347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.368137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.368137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.380587] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 671.571480] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.646185] env[65788]: INFO networking_nsxv3.common.synchronization [None req-67b29972-61da-4a08-82eb-04289d427a5e None None] Enqueued Resource ID: 36585f18-1657-4dfb-8dc2-7f7a77f06b3d with Priority: HIGHEST for action port [ 671.646185] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36585f18-1657-4dfb-8dc2-7f7a77f06b3d with Priority: HIGHEST for action port [ 671.646185] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-36585f18-1657-4dfb-8dc2-7f7a77f06b3d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.646185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36585f18-1657-4dfb-8dc2-7f7a77f06b3d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.646185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36585f18-1657-4dfb-8dc2-7f7a77f06b3d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.646185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36585f18-1657-4dfb-8dc2-7f7a77f06b3d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.646740] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36585f18-1657-4dfb-8dc2-7f7a77f06b3d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.725297] env[65788]: INFO networking_nsxv3.common.synchronization [None req-0f5fea27-36a1-4e72-bb11-9fd39e4df961 tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 671.727150] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 671.727150] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.727150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.727150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.727150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.727150] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.765160] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.075459] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.075788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.075788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.076208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.076365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.076493] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 is going to be created. [ 672.112139] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.112308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.112432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.112757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.112757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.126221] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: UNINITIALIZED for 2s [ 672.151061] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36585f18-1657-4dfb-8dc2-7f7a77f06b3d [ 672.151061] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.151061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.151061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.151061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.151061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.151061] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36585f18-1657-4dfb-8dc2-7f7a77f06b3d already deleted. [ 672.151061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36585f18-1657-4dfb-8dc2-7f7a77f06b3d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.250834] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.251045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.251096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.251317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.251404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.251504] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf already deleted. [ 672.251586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.267957] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.267957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.267957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.268399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.268850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.268850] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 672.305646] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.305821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.305864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.306459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.306459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.316967] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 672.334145] env[65788]: INFO networking_nsxv3.common.synchronization [None req-9b5dc56c-ee8b-43f1-ae13-fdf826e74872 tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 672.334145] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 672.334145] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.334145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.334145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.335343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.335343] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.863426] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.863905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.863905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.864165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.864315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.864406] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf already deleted. [ 672.864464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.953976] env[65788]: INFO networking_nsxv3.common.synchronization [None req-30565d9e-4cca-4cc7-b825-465eaa5b102f None None] Enqueued Resource ID: af5d4ddb-3fc0-4f41-890c-b44d92efe5ee with Priority: HIGHEST for action port [ 672.954621] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5d4ddb-3fc0-4f41-890c-b44d92efe5ee with Priority: HIGHEST for action port [ 672.954929] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-af5d4ddb-3fc0-4f41-890c-b44d92efe5ee taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.955194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af5d4ddb-3fc0-4f41-890c-b44d92efe5ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.955268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af5d4ddb-3fc0-4f41-890c-b44d92efe5ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.955519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af5d4ddb-3fc0-4f41-890c-b44d92efe5ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.955604] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5d4ddb-3fc0-4f41-890c-b44d92efe5ee',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.396447] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 673.396447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.396447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.396447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.396447] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.459080] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af5d4ddb-3fc0-4f41-890c-b44d92efe5ee [ 673.459373] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.459550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.459635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.459829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.459921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.460283] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af5d4ddb-3fc0-4f41-890c-b44d92efe5ee already deleted. [ 673.460283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af5d4ddb-3fc0-4f41-890c-b44d92efe5ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.899663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.899984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.138658] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: SUCCESS [ 674.140957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.140957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.140957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.141205] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.141205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.141313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.141398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.141809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.141809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.141809] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.331603] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 674.332028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.332402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.332767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.333106] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.333378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.333533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.333836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.333998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.334222] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.644879] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.645224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.645359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.645513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.645711] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.645888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.645972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.646199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.646277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.646330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.646646] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.646769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.646852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.647645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.647645] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.647645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.647645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.647865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.647865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.648280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.648428] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.838845] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.153283] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e17bee3e-2368-47f5-851f-96deb4d04a56: rpc.has_security_group_logging(os_id): False [ 675.172419] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.172839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.172839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.172839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.173051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.174876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.174876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.174876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.174876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.175513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.175513] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 is going to be created. [ 675.236224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.236887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.236887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.236887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.236887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.248897] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: IN_PROGRESS for 2s [ 675.341462] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.423882] env[65788]: INFO networking_nsxv3.common.synchronization [None req-cdb9ba00-2bd0-4f8d-8ad8-43f43f971ac3 None None] Enqueued Resource ID: 9edfe593-142e-46cb-ad04-96a96ef28f6e with Priority: HIGHEST for action port [ 675.424165] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9edfe593-142e-46cb-ad04-96a96ef28f6e with Priority: HIGHEST for action port [ 675.424842] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9edfe593-142e-46cb-ad04-96a96ef28f6e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.424842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9edfe593-142e-46cb-ad04-96a96ef28f6e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.425011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9edfe593-142e-46cb-ad04-96a96ef28f6e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.425576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9edfe593-142e-46cb-ad04-96a96ef28f6e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.425740] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9edfe593-142e-46cb-ad04-96a96ef28f6e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.844323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.845139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.845139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.845139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.845139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.845139] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 675.876364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.876364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.876364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.876364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.876364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.887544] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 675.929561] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9edfe593-142e-46cb-ad04-96a96ef28f6e [ 675.929804] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.929950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.930032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.930266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.930360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.930467] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9edfe593-142e-46cb-ad04-96a96ef28f6e already deleted. [ 675.930555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9edfe593-142e-46cb-ad04-96a96ef28f6e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.532769] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2b1262-72ef-4581-93a7-518b8d11194e req-cfbef6c3-d89f-4ddc-91f4-515bb4be02a7 tempest-ServersAdminNegativeTestJSON-2035322777 tempest-ServersAdminNegativeTestJSON-2035322777-project-member] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 676.533159] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 676.534520] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.535225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.535225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.535225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.535225] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.535225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.535521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.535521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.535899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.536066] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.005502] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.005689] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.005807] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.006129] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.006381] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.006530] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.006640] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.006839] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.006976] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.007188] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.007295] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.007399] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.007549] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.007722] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.007847] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.007985] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.030206] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.030206] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.030206] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.030206] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.030206] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.030206] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.030206] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.030206] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.030206] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c9d734-f09a-4eaf-bc8d-08c601c0e41e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.039291] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.039458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.039517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.039724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.039783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.039950] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.040075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.040141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.040286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.040360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.040445] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b already deleted. [ 677.040523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.096235] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e10aacab-2cdd-4e8e-90eb-62f6410b8a95 None None] Enqueued Resource ID: ad02e08f-b45c-416d-9304-b3862390236c with Priority: HIGHEST for action port [ 677.096785] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad02e08f-b45c-416d-9304-b3862390236c with Priority: HIGHEST for action port [ 677.097110] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad02e08f-b45c-416d-9304-b3862390236c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.097236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad02e08f-b45c-416d-9304-b3862390236c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.097306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad02e08f-b45c-416d-9304-b3862390236c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.098146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad02e08f-b45c-416d-9304-b3862390236c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.098146] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad02e08f-b45c-416d-9304-b3862390236c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.264620] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: SUCCESS [ 677.264862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.291944] env[65788]: INFO networking_nsxv3.common.synchronization [None req-19b595f6-64f3-4247-9fbd-248f0ba4bb82 None None] Enqueued Resource ID: 203419f4-561f-4a91-9af1-f6dd504f3ee4 with Priority: HIGHEST for action port [ 677.292561] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203419f4-561f-4a91-9af1-f6dd504f3ee4 with Priority: HIGHEST for action port [ 677.292838] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-203419f4-561f-4a91-9af1-f6dd504f3ee4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.292945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-203419f4-561f-4a91-9af1-f6dd504f3ee4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.293084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-203419f4-561f-4a91-9af1-f6dd504f3ee4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.293362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-203419f4-561f-4a91-9af1-f6dd504f3ee4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.293447] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203419f4-561f-4a91-9af1-f6dd504f3ee4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.532205] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.532440] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.532572] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.534390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.534390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.534390] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 88c9d734-f09a-4eaf-bc8d-08c601c0e41e not found, creating... [ 677.534390] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.534390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.534390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.534390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.534390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.534390] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.534390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.535193] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.535193] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.535193] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.535193] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 88c9d734-f09a-4eaf-bc8d-08c601c0e41e is going to be created. [ 677.584814] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.584814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.584814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.584814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.584814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.584814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.600657] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad02e08f-b45c-416d-9304-b3862390236c [ 677.601953] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.601953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.601953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.601953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.601953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.601953] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad02e08f-b45c-416d-9304-b3862390236c already deleted. [ 677.601953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad02e08f-b45c-416d-9304-b3862390236c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.795978] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 203419f4-561f-4a91-9af1-f6dd504f3ee4 [ 677.797655] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.798681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.798883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.799202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.799330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.799454] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:203419f4-561f-4a91-9af1-f6dd504f3ee4 already deleted. [ 677.799545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-203419f4-561f-4a91-9af1-f6dd504f3ee4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.900427] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 677.900645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.900956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.901208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.901484] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.901631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.901882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.902082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.902175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.902322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.902483] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.409081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.409081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.409081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.409081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.409081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.410941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.414109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.414109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.414109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.414109] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.414109] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2b1262-72ef-4581-93a7-518b8d11194e req-3ee1c445-afc3-4a16-934d-88bbddd4c97c service nova] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_rules [ 678.414109] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2b1262-72ef-4581-93a7-518b8d11194e req-3ee1c445-afc3-4a16-934d-88bbddd4c97c service nova] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 678.414109] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2b1262-72ef-4581-93a7-518b8d11194e req-3ee1c445-afc3-4a16-934d-88bbddd4c97c service nova] Enqueued Resource ID: 88c9d734-f09a-4eaf-bc8d-08c601c0e41e with Priority: HIGHEST for action port [ 678.417405] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_rules [ 678.417405] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 678.417405] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c9d734-f09a-4eaf-bc8d-08c601c0e41e with Priority: HIGHEST for action port [ 678.417405] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.417405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.417405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.417405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.417405] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.417405] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.417405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.418289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.418289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.418289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.418289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.418459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.418724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.418797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.418894] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.420762] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.420762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.420762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.420762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.420762] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c9d734-f09a-4eaf-bc8d-08c601c0e41e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.916708] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fca49d1-97b5-45f3-9237-0af8e319bb34: rpc.has_security_group_logging(os_id): False [ 678.923014] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.924139] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.924299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.924430] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88c9d734-f09a-4eaf-bc8d-08c601c0e41e with status ACTIVE [ 678.924580] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.924701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.924781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.925197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.925197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.925355] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.925439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.925503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.925904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.925904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.925904] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.926076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.926911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.927201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.927298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.927468] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88c9d734-f09a-4eaf-bc8d-08c601c0e41e is going to be updated. [ 678.940389] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.940538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.940590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.941700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.941700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.941700] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.941900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.941940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.942125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.942191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.942663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.942663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.942663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.942663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.942879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.942933] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.943322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.943544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.943613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.943664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.943892] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 678.949756] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.949849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.949849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.950059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.950211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.950415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88c9d734-f09a-4eaf-bc8d-08c601c0e41e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.010291] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.010291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.010291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.010827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.010827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.025992] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 679.429476] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.933925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.934309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.934309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.937018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.937018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.937018] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b is going to be created. [ 679.961218] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.961322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.961322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.961546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.961705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.973035] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: UNINITIALIZED for 2s [ 680.051620] env[65788]: INFO networking_nsxv3.common.synchronization [None req-8c411937-23d3-4867-b0c8-f961bc9df5ce tempest-ServersV294TestFqdnHostnames-200598053 tempest-ServersV294TestFqdnHostnames-200598053-project-member] Enqueued Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_rules [ 680.052295] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_rules [ 680.052651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.052746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.052813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.054216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.054216] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.192887] env[65788]: INFO networking_nsxv3.common.synchronization [req-186f9022-91a7-4db2-91b3-4348e5db9f69 req-d895e9cc-1526-4d17-bca8-dfd6e30259ac tempest-DeleteServersAdminTestJSON-2055679758 tempest-DeleteServersAdminTestJSON-2055679758-project-member] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 680.195498] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGHEST for action security_group_members [ 680.196628] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.196628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.196628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.196628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.196628] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.196628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.196628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.197024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.197024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.197024] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.320878] env[65788]: INFO networking_nsxv3.common.synchronization [None req-5e669e17-7cb2-4344-8810-066e1a85528c tempest-ServersV294TestFqdnHostnames-200598053 tempest-ServersV294TestFqdnHostnames-200598053-project-member] Enqueued Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_rules [ 680.321564] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_rules [ 680.322041] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.322237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.576137] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.576137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.576365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.576775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.576775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.576775] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 already deleted. [ 680.576775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.577247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.577247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.577366] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.701986] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.704695] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.704695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.704695] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be updated. [ 680.744174] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.744174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.744304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.744466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.744610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.756296] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: IN_PROGRESS for 2s [ 680.815776] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f9c4adae-e02d-44bf-8612-e8a3cc07ab33 None None] Enqueued Resource ID: 9c60a946-225b-4f0e-8114-46d482f42e2f with Priority: HIGHEST for action port [ 680.816564] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c60a946-225b-4f0e-8114-46d482f42e2f with Priority: HIGHEST for action port [ 680.818254] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c60a946-225b-4f0e-8114-46d482f42e2f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.818254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c60a946-225b-4f0e-8114-46d482f42e2f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.818254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c60a946-225b-4f0e-8114-46d482f42e2f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.818254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c60a946-225b-4f0e-8114-46d482f42e2f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.818254] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c60a946-225b-4f0e-8114-46d482f42e2f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.041489] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 681.041489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.041927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.041927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.042087] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.100749] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.101872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.101872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.101872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.101872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.101872] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 already deleted. [ 681.101872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.319536] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c60a946-225b-4f0e-8114-46d482f42e2f [ 681.319778] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.319945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.319998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.320232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.320282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.320379] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c60a946-225b-4f0e-8114-46d482f42e2f already deleted. [ 681.320462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c60a946-225b-4f0e-8114-46d482f42e2f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.334713] env[65788]: INFO networking_nsxv3.common.synchronization [req-88ff047a-98ba-476e-afb0-31720157dfcb req-3a285eb1-09b1-48f6-a37a-a2995bde41df tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 681.335276] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 681.335639] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.335804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.335895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.336198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.336402] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.336514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.336576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.336747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.336837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.336965] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.545042] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.545042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.546535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.546535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.546535] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.546535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.546535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.546535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.546535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.546535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.546535] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.796553] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.796553] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.796762] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.797651] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.800167] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.800167] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.800167] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.800167] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.800167] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.801159] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.801159] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.801159] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.801159] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.801159] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.801159] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.801159] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.824756] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.825823] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.826332] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.828060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.828060] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-496a240b-cd40-4e70-9906-dede323a8c87 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.828060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.828060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.828060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.828060] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('496a240b-cd40-4e70-9906-dede323a8c87',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.839136] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.839136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.839329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.839750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.839750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.839903] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.840032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.840125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.840327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.841953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.841953] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 already deleted. [ 681.841953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.984783] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: SUCCESS [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.986972] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.986972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.986972] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.048987] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.049335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.049335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.049526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.049822] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.049934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.049978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.050153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.050241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.050362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.050556] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.050682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.050735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.051106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.051346] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.051474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.051544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.051702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.051801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.051902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.051989] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.332262] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.332547] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.332623] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.332875] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.333045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.333200] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 496a240b-cd40-4e70-9906-dede323a8c87 not found, creating... [ 682.333537] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.333715] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.333833] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.334379] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.334379] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.334619] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.334750] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.335421] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.336278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.336278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.336278] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 496a240b-cd40-4e70-9906-dede323a8c87 is going to be created. [ 682.356169] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.356401] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.356566] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.356824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.357099] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.357333] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.490353] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.490609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.490609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.491145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.491145] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.491409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.491409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.491624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.491624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.491624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.491814] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.491917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.491985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.492240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.492310] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.492374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.492425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.492571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.492635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.492715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.492806] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.554386] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fca49d1-97b5-45f3-9237-0af8e319bb34: rpc.has_security_group_logging(os_id): False [ 682.574521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.574521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.574639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.575487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.575487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.575487] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.575487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.575487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.575776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.575776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.575849] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.575948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.575992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.577264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.577264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.577264] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.577264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.577264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.577264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.577264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.577264] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 682.640643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.640882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.640935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.641143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.641289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.659953] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 682.756725] env[65788]: INFO networking_nsxv3.common.synchronization [None req-9c0d39b7-93a6-4e3b-9711-f59c7739afe4 None None] Enqueued Resource ID: 0ddda20d-2b8c-45ec-8e8e-123b3eb90873 with Priority: HIGHEST for action port [ 682.758105] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ddda20d-2b8c-45ec-8e8e-123b3eb90873 with Priority: HIGHEST for action port [ 682.758490] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ddda20d-2b8c-45ec-8e8e-123b3eb90873 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.758635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ddda20d-2b8c-45ec-8e8e-123b3eb90873" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.758635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ddda20d-2b8c-45ec-8e8e-123b3eb90873" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.758919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ddda20d-2b8c-45ec-8e8e-123b3eb90873" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.759101] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ddda20d-2b8c-45ec-8e8e-123b3eb90873',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.767490] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4798ea04-8c6d-401c-8b54-65632bb263de in Status: SUCCESS [ 682.767657] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de deletion is rescheduled due to dependency. [ 682.767769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.995584] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ea6710-254c-4bc8-955c-3558da8ea95b: rpc.has_security_group_logging(os_id): False [ 683.016651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.016651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.016831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.016936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.017037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.017228] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.017334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.017396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.017547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.017624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.017808] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.017903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.017965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.018124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.018199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.018392] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.018485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.018544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.018689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.018781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.018887] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b is going to be created. [ 683.069469] env[65788]: INFO networking_nsxv3.common.synchronization [req-88ff047a-98ba-476e-afb0-31720157dfcb req-6aab230e-ace2-48fe-b47f-ca0ac3e1c005 service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 683.069773] env[65788]: INFO networking_nsxv3.common.synchronization [req-88ff047a-98ba-476e-afb0-31720157dfcb req-6aab230e-ace2-48fe-b47f-ca0ac3e1c005 service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 683.069773] env[65788]: INFO networking_nsxv3.common.synchronization [req-88ff047a-98ba-476e-afb0-31720157dfcb req-6aab230e-ace2-48fe-b47f-ca0ac3e1c005 service nova] Enqueued Resource ID: 496a240b-cd40-4e70-9906-dede323a8c87 with Priority: HIGHEST for action port [ 683.070348] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 683.070487] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 683.070588] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 496a240b-cd40-4e70-9906-dede323a8c87 with Priority: HIGHEST for action port [ 683.071166] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.071304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.071304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.071959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.071959] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.072561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.072711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.072711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.073883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.073883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.073883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.073883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.073883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.073883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.074278] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.075328] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-496a240b-cd40-4e70-9906-dede323a8c87 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.075465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.075537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.075692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.075768] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('496a240b-cd40-4e70-9906-dede323a8c87',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.080289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.080468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.080569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.080761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.081039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.105582] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: IN_PROGRESS for 2s [ 683.261985] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ddda20d-2b8c-45ec-8e8e-123b3eb90873 [ 683.262248] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.262381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.262449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.262718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.262796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.262875] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ddda20d-2b8c-45ec-8e8e-123b3eb90873 already deleted. [ 683.263364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ddda20d-2b8c-45ec-8e8e-123b3eb90873" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.576449] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.577590] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 496a240b-cd40-4e70-9906-dede323a8c87 with status ACTIVE [ 683.577831] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.577970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.578074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.578263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.578337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.578523] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.580015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.580015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.580015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.580015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.580015] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.580015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.580556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.580556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.580556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.580556] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 496a240b-cd40-4e70-9906-dede323a8c87 is going to be updated. [ 683.583950] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.583950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.611866] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.612188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.612238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.612534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.612760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.613496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-496a240b-cd40-4e70-9906-dede323a8c87" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.083401] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.588692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.588957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.589021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.589272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.589386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.589531] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be created. [ 684.619510] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.619658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.619726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.619946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.620125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.632780] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: UNINITIALIZED for 2s [ 684.675900] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 684.676245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.122263] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: SUCCESS [ 685.122844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.612200] env[65788]: INFO networking_nsxv3.common.synchronization [req-68aebc21-b7a8-4cd1-91a8-83d80b79789f req-55de01e0-a31a-4d77-b7e6-342732cb9a8f tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 685.612779] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 685.613345] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.613345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.613794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.613794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.613794] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.614641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.614641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.614641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.614641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.614641] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.703708] env[65788]: INFO networking_nsxv3.common.synchronization [req-e30b4baa-daef-4c94-849b-a02084551159 req-970b6140-bd73-4f09-bada-6aa2c33955e9 tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 685.704736] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 685.705889] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.706285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.706390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.706699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.707240] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.707428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.707428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.707777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.707777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.708994] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.118149] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.155017] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.155373] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.155373] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.156201] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.156527] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.156769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.157301] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.157890] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.158095] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.158345] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.158457] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.158560] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.161018] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.161018] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.161018] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.161018] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.183733] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.183903] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.184052] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.184233] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.184555] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-5f5263c5-dd17-4088-94e4-b313783f200a taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.184725] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.184837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.185182] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.185316] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f5263c5-dd17-4088-94e4-b313783f200a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.210091] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.210400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.210515] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.210740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.210884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.211131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.211249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.211322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.211696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.212434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.212434] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 686.246511] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.246698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.246755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.247040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.247186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.256597] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 686.587335] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3407818f-4071-45d8-bc24-763bad955559 None None] Enqueued Resource ID: 119ef6f5-93ca-4d42-9c68-5e0291a170e3 with Priority: HIGHEST for action port [ 686.589120] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 119ef6f5-93ca-4d42-9c68-5e0291a170e3 with Priority: HIGHEST for action port [ 686.589490] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-119ef6f5-93ca-4d42-9c68-5e0291a170e3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.589640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-119ef6f5-93ca-4d42-9c68-5e0291a170e3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.589709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-119ef6f5-93ca-4d42-9c68-5e0291a170e3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.589980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-119ef6f5-93ca-4d42-9c68-5e0291a170e3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.590083] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('119ef6f5-93ca-4d42-9c68-5e0291a170e3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.620101] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.644070] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 686.644296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.644469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.644709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.644875] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.645033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.645105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.645260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.645356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.645433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.645523] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.688590] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.688590] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.688751] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.689176] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.689176] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.689305] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 5f5263c5-dd17-4088-94e4-b313783f200a not found, creating... [ 686.689729] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.689842] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.689898] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.690108] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.690263] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.690981] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.690981] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.690981] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.691934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.692105] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.692247] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 5f5263c5-dd17-4088-94e4-b313783f200a is going to be created. [ 686.714335] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.714470] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.714518] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.714837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.715172] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.715422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.094306] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 119ef6f5-93ca-4d42-9c68-5e0291a170e3 [ 687.094552] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.095316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.095316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.095316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.095316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.095316] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:119ef6f5-93ca-4d42-9c68-5e0291a170e3 already deleted. [ 687.095316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-119ef6f5-93ca-4d42-9c68-5e0291a170e3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.125041] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.125041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.125041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.125041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.125041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.125041] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 687.152544] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.152761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.152761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.152992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.153265] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.154049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.154049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.154049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.154049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.154049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.154049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.154399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.154399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.154399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.154509] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.154664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.154664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.154841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.154900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.154947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.155085] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.198882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.199133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.199194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.199377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.199519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.209590] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 687.452918] env[65788]: INFO networking_nsxv3.common.synchronization [req-68aebc21-b7a8-4cd1-91a8-83d80b79789f req-40c5b692-0ee6-463c-97e8-af4e4d172df8 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 687.453178] env[65788]: INFO networking_nsxv3.common.synchronization [req-68aebc21-b7a8-4cd1-91a8-83d80b79789f req-40c5b692-0ee6-463c-97e8-af4e4d172df8 service nova] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 687.453297] env[65788]: INFO networking_nsxv3.common.synchronization [req-68aebc21-b7a8-4cd1-91a8-83d80b79789f req-40c5b692-0ee6-463c-97e8-af4e4d172df8 service nova] Enqueued Resource ID: 5f5263c5-dd17-4088-94e4-b313783f200a with Priority: HIGHEST for action port [ 687.453859] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_rules [ 687.454092] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 687.454272] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f5263c5-dd17-4088-94e4-b313783f200a with Priority: HIGHEST for action port [ 687.454593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.454720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.455301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.455301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.455301] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.456744] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.456892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.459189] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f5263c5-dd17-4088-94e4-b313783f200a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.459368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.459368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.459723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.459723] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f5263c5-dd17-4088-94e4-b313783f200a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.659352] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1: rpc.has_security_group_logging(os_id): False [ 687.685261] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.685439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.685522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.685713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.685790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.686020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.686140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.686227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.686468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.686468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.686663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.686750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.686815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.686939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.687018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.687215] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.687284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.687334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.687535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.687535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.687615] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be created. [ 687.788697] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.789013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.789013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.789833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.789833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.807129] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 687.961357] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.961581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.961703] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f5263c5-dd17-4088-94e4-b313783f200a with status ACTIVE [ 687.961806] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.961900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.961972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.962972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.962972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.962972] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.962972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.962972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.962972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.962972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.963863] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.964022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.964114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.964344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.964470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.964594] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f5263c5-dd17-4088-94e4-b313783f200a is going to be updated. [ 687.993760] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.993988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.993988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.994271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.994543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.994836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f5263c5-dd17-4088-94e4-b313783f200a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.052803] env[65788]: INFO networking_nsxv3.common.synchronization [req-140c3c85-7e8a-4306-9972-11cb541d6f7c req-b448c577-43d8-4cbf-9075-ef57e83f411b tempest-TenantUsagesTestJSON-417307340 tempest-TenantUsagesTestJSON-417307340-project-member] Enqueued Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_members [ 688.053483] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGHEST for action security_group_members [ 688.053882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.054011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.055127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.055570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.055895] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.056154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.056616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.056995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.057158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.057327] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.127849] env[65788]: INFO networking_nsxv3.common.synchronization [None req-8f612ff0-1872-4470-bf22-aff5d14978ac None None] Enqueued Resource ID: 665df24c-6536-4dba-8363-1ed8ddc90da9 with Priority: HIGHEST for action port [ 688.128777] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665df24c-6536-4dba-8363-1ed8ddc90da9 with Priority: HIGHEST for action port [ 688.130062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-665df24c-6536-4dba-8363-1ed8ddc90da9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.130062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-665df24c-6536-4dba-8363-1ed8ddc90da9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.130062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-665df24c-6536-4dba-8363-1ed8ddc90da9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.130062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-665df24c-6536-4dba-8363-1ed8ddc90da9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.130062] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('665df24c-6536-4dba-8363-1ed8ddc90da9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.267948] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 688.268378] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 deletion is rescheduled due to dependency. [ 688.268378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.315044] env[65788]: INFO networking_nsxv3.common.synchronization [req-9227d10c-1ca7-41c6-93fb-3d22f0cc85a4 req-5c05c660-c416-4f08-89f1-f31cb13a5b8d tempest-ListServersNegativeTestJSON-1369105691 tempest-ListServersNegativeTestJSON-1369105691-project-member] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 688.315843] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 688.315975] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.316061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.316120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.316316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.316468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.316572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.316630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.316778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.316863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.316960] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.561009] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.561199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.561308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.561636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.561636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.561752] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.561840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.561893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.562053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.562147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.562219] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 is going to be updated. [ 688.593672] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.593807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.593807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.593976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.594116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.605151] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 in Status: IN_PROGRESS for 2s [ 688.633993] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 665df24c-6536-4dba-8363-1ed8ddc90da9 [ 688.635414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.635578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.635651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.635925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.636035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.636146] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:665df24c-6536-4dba-8363-1ed8ddc90da9 already deleted. [ 688.636261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-665df24c-6536-4dba-8363-1ed8ddc90da9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.820069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.129308] env[65788]: INFO networking_nsxv3.common.synchronization [req-1a72555f-d029-4e79-aa3b-304d0e8de3cc req-4b9b174b-f933-440e-9e53-e39f64f4cfea tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 689.129861] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 689.130171] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.130412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.130412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.130858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.130858] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.130858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.131090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.131683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.132654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.133030] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.222733] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 689.223727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.224223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.224223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.227244] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.227450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.227533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.227780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.227895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.228069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.325586] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.635272] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.635491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.635620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.635903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.636049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.636352] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.636495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.636567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.636734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.637153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.637153] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb already deleted. [ 689.637153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.675662] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.676225] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.676580] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.677314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.677912] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.678442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.678730] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.679285] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.679663] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.680068] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.680305] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.680527] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.680732] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.680968] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.681176] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.681435] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.708302] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.708532] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.708682] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.708859] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.709219] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-f71491fa-7f52-43ef-89bb-1c5e43edb92e taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.709438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.709567] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.709903] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.710047] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f71491fa-7f52-43ef-89bb-1c5e43edb92e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.731052] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.822143] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 689.822320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.829921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.830151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.830202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.830383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.830482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.830627] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 689.867244] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.867466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.867530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.867967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.868405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.878332] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 690.212640] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.212793] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.212912] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.213137] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.213524] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.213524] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port f71491fa-7f52-43ef-89bb-1c5e43edb92e not found, creating... [ 690.213844] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.213957] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.214260] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.214682] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.214803] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.215120] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.215281] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.215391] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.215680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.215746] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.215905] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: f71491fa-7f52-43ef-89bb-1c5e43edb92e is going to be created. [ 690.233052] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.239396] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.239624] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.239732] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.240153] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.240251] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.240471] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.516020] env[65788]: INFO networking_nsxv3.common.synchronization [None req-20b9f5a1-5c64-4d8d-b150-dce9ea726777 None None] Enqueued Resource ID: 028ca280-0622-4ae6-8c02-a191023a372c with Priority: HIGHEST for action port [ 690.516377] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 028ca280-0622-4ae6-8c02-a191023a372c with Priority: HIGHEST for action port [ 690.516733] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-028ca280-0622-4ae6-8c02-a191023a372c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.516907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-028ca280-0622-4ae6-8c02-a191023a372c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.516990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-028ca280-0622-4ae6-8c02-a191023a372c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.520258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-028ca280-0622-4ae6-8c02-a191023a372c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.520360] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('028ca280-0622-4ae6-8c02-a191023a372c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.616024] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 in Status: SUCCESS [ 690.616024] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 deletion is rescheduled due to dependency. [ 690.616024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.737184] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.739133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.739133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.739133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.739133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.739133] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 690.772132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.772132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.772132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.772132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.772132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.786641] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 691.009817] env[65788]: INFO networking_nsxv3.common.synchronization [req-1a72555f-d029-4e79-aa3b-304d0e8de3cc req-94eedb9a-b504-471c-8173-6288f41bc472 service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 691.010078] env[65788]: INFO networking_nsxv3.common.synchronization [req-1a72555f-d029-4e79-aa3b-304d0e8de3cc req-94eedb9a-b504-471c-8173-6288f41bc472 service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 691.010642] env[65788]: INFO networking_nsxv3.common.synchronization [req-1a72555f-d029-4e79-aa3b-304d0e8de3cc req-94eedb9a-b504-471c-8173-6288f41bc472 service nova] Enqueued Resource ID: f71491fa-7f52-43ef-89bb-1c5e43edb92e with Priority: HIGHEST for action port [ 691.010954] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 691.010954] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 691.011888] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71491fa-7f52-43ef-89bb-1c5e43edb92e with Priority: HIGHEST for action port [ 691.012823] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.013068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.013310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.013807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.013976] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.016558] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.016692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.016763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.016960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.017136] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.017244] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.017433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.017504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.017549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.017696] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.022614] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f71491fa-7f52-43ef-89bb-1c5e43edb92e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.022758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.022758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.023013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.023091] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f71491fa-7f52-43ef-89bb-1c5e43edb92e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.026220] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 028ca280-0622-4ae6-8c02-a191023a372c [ 691.026220] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.026220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.026220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.026220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.026220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.026220] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:028ca280-0622-4ae6-8c02-a191023a372c already deleted. [ 691.026220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-028ca280-0622-4ae6-8c02-a191023a372c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.375890] env[65788]: INFO networking_nsxv3.common.synchronization [req-83541d60-9e6a-4120-959d-d1cd12b99ab8 req-3ee9335b-14d0-4cf4-8242-5d5517958cd9 tempest-InstanceActionsV221TestJSON-877900018 tempest-InstanceActionsV221TestJSON-877900018-project-member] Enqueued Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_members [ 691.376660] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_members [ 691.376934] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.377062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.377309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.377395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.377464] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.377578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.377646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.377777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.377850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.378069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.524918] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.525243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.525291] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.526146] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f71491fa-7f52-43ef-89bb-1c5e43edb92e with status ACTIVE [ 691.526318] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.526430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.526514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.526692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.526775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.527032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.527143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.527203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.527355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.527429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.527631] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.527760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.527824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.527966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.530671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.530671] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f71491fa-7f52-43ef-89bb-1c5e43edb92e is going to be updated. [ 691.554434] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.554580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.554626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.556105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.556261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.556433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f71491fa-7f52-43ef-89bb-1c5e43edb92e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.583545] env[65788]: INFO networking_nsxv3.common.synchronization [None req-0252845a-7653-490b-8bd0-7c17806093ea None None] Enqueued Resource ID: 8317b21d-7a7a-4b0b-8548-5967cf6c7e0f with Priority: HIGHEST for action port [ 691.583966] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8317b21d-7a7a-4b0b-8548-5967cf6c7e0f with Priority: HIGHEST for action port [ 691.584310] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8317b21d-7a7a-4b0b-8548-5967cf6c7e0f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.584436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8317b21d-7a7a-4b0b-8548-5967cf6c7e0f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.584503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8317b21d-7a7a-4b0b-8548-5967cf6c7e0f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.584776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8317b21d-7a7a-4b0b-8548-5967cf6c7e0f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.584863] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8317b21d-7a7a-4b0b-8548-5967cf6c7e0f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.763487] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.763815] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.764034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.766468] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.766783] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.766954] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.767084] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.767435] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.768893] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.768893] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.768893] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.768893] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.768893] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.768893] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.768893] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.768893] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.792022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.792022] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.792022] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.792022] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.792022] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-54dd539a-9b3b-4b27-9e63-9833b022a6bd taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.792022] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.792022] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.792451] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.792633] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54dd539a-9b3b-4b27-9e63-9833b022a6bd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.883878] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.883878] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.883878] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 already deleted. [ 691.883878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.890202] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 691.890400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.035057] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.088217] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8317b21d-7a7a-4b0b-8548-5967cf6c7e0f [ 692.088360] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.088459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.088459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.088669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.088762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.088972] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8317b21d-7a7a-4b0b-8548-5967cf6c7e0f already deleted. [ 692.089737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8317b21d-7a7a-4b0b-8548-5967cf6c7e0f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.299007] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.299321] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.299447] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.299719] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.299868] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.300108] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 54dd539a-9b3b-4b27-9e63-9833b022a6bd not found, creating... [ 692.300406] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.300560] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.300719] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.300960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.301123] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.301407] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.301571] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.301682] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.301906] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.303185] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.305149] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 54dd539a-9b3b-4b27-9e63-9833b022a6bd is going to be created. [ 692.324698] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.326705] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.326705] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.326705] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.326705] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.326705] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.542260] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.542913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.542913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.542913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.542913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.542913] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be created. [ 692.568302] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.568487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.568487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.568695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.568975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.579483] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: UNINITIALIZED for 2s [ 692.803479] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 692.803718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.804340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.804621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.804834] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.804986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.805058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.805206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.805363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.809264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.809264] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.088630] env[65788]: INFO networking_nsxv3.common.synchronization [req-83541d60-9e6a-4120-959d-d1cd12b99ab8 req-cd403878-7c7a-4a0b-b53e-ea45091ae217 service nova] Enqueued Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_rules [ 693.089140] env[65788]: INFO networking_nsxv3.common.synchronization [req-83541d60-9e6a-4120-959d-d1cd12b99ab8 req-cd403878-7c7a-4a0b-b53e-ea45091ae217 service nova] Enqueued Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_members [ 693.089140] env[65788]: INFO networking_nsxv3.common.synchronization [req-83541d60-9e6a-4120-959d-d1cd12b99ab8 req-cd403878-7c7a-4a0b-b53e-ea45091ae217 service nova] Enqueued Resource ID: 54dd539a-9b3b-4b27-9e63-9833b022a6bd with Priority: HIGHEST for action port [ 693.089691] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_rules [ 693.089858] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_members [ 693.090022] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54dd539a-9b3b-4b27-9e63-9833b022a6bd with Priority: HIGHEST for action port [ 693.090297] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.090437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.090507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.090753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.090836] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.092563] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.092563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.092563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.092563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.092841] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.092841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.092929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.093764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.093764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.093764] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.094071] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-54dd539a-9b3b-4b27-9e63-9833b022a6bd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.094186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.094394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.094749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.094749] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54dd539a-9b3b-4b27-9e63-9833b022a6bd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.311304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.311467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.311539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.311784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.312035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.312151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.312217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.312381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.312470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.312558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.312714] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.312805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.313520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.313520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.313520] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.313520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.313520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.314808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.314890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.314998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.315115] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.593746] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.593746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.596154] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.599132] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54dd539a-9b3b-4b27-9e63-9833b022a6bd with status ACTIVE [ 693.599132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.599132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.599132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.599132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.599962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.599962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.599962] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54dd539a-9b3b-4b27-9e63-9833b022a6bd is going to be updated. [ 693.623610] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.623610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.623610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.623911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.623949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.624113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54dd539a-9b3b-4b27-9e63-9833b022a6bd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.821906] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e: rpc.has_security_group_logging(os_id): False [ 693.840401] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.840401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.840527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.840694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.840785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.840999] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.841130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.841193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.841350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.841425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.841640] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.841732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.841791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.841981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.842897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.844043] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.844284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.844388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.844555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.844635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.844827] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 693.913880] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.915274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.915274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.915274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.915274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.931811] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 694.102762] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.592367] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 694.592584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.592749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.592971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.593164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.593283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.593346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.593497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.593574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.593658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.593751] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.604512] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.604825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.604825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.605029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.605373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.607032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 is going to be created. [ 694.633121] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.633323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.633391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.633555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.634681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.645345] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 in Status: UNINITIALIZED for 2s [ 694.674465] env[65788]: INFO networking_nsxv3.common.synchronization [None req-53b6dd47-9e31-4496-836c-7918d1e29872 None None] Enqueued Resource ID: ebecb557-f305-40d6-bb9b-84f6884868df with Priority: HIGHEST for action port [ 694.674465] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebecb557-f305-40d6-bb9b-84f6884868df with Priority: HIGHEST for action port [ 694.674465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebecb557-f305-40d6-bb9b-84f6884868df taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.674465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebecb557-f305-40d6-bb9b-84f6884868df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.674465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebecb557-f305-40d6-bb9b-84f6884868df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.674465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebecb557-f305-40d6-bb9b-84f6884868df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.674814] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebecb557-f305-40d6-bb9b-84f6884868df',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.718483] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b9b74e5c-c662-4d82-a6d2-3fd48d6976e7 None None] Enqueued Resource ID: e4820987-8c65-423c-97e1-67015d9139b7 with Priority: HIGHEST for action port [ 694.719228] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4820987-8c65-423c-97e1-67015d9139b7 with Priority: HIGHEST for action port [ 694.719579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4820987-8c65-423c-97e1-67015d9139b7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.719786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4820987-8c65-423c-97e1-67015d9139b7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.719786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4820987-8c65-423c-97e1-67015d9139b7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.720104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4820987-8c65-423c-97e1-67015d9139b7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.720365] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4820987-8c65-423c-97e1-67015d9139b7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.096855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.098660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.099093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.099433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.099727] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.100452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.100828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.101124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.101311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.101491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.101742] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.101975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.102164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.102408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.102700] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.103016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.103306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.103612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.103965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.104194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.104501] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.179621] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebecb557-f305-40d6-bb9b-84f6884868df [ 695.180149] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.180149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.180149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.180578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.180795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.180795] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebecb557-f305-40d6-bb9b-84f6884868df already deleted. [ 695.181028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebecb557-f305-40d6-bb9b-84f6884868df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.225946] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4820987-8c65-423c-97e1-67015d9139b7 [ 695.225946] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.225946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.225946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.225946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.225946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.225946] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4820987-8c65-423c-97e1-67015d9139b7 already deleted. [ 695.225946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4820987-8c65-423c-97e1-67015d9139b7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.607658] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f8fa77-dfd6-4877-84c2-f9760d23fdfb: rpc.has_security_group_logging(os_id): False [ 695.630062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.630062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.630062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.630401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.630401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.630512] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.630612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.631750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.631750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.631750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.631750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.631750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.631750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.631750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.631750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.632147] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.632147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.632147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.632147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.632316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.632316] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be created. [ 695.699891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.700051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.700192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.700353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.700539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.715740] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 695.953796] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 695.953796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.657555] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 in Status: UNINITIALIZED for 4s [ 697.731678] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 697.732024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.789473] env[65788]: INFO networking_nsxv3.common.synchronization [req-1e91254d-894e-4839-bdd8-8f3a5cf36c4a req-0378c899-1928-4de6-8bb1-3e86f71fc013 tempest-FloatingIPsAssociationNegativeTestJSON-120723859 tempest-FloatingIPsAssociationNegativeTestJSON-120723859-project-member] Enqueued Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_members [ 697.789473] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 with Priority: HIGHEST for action security_group_members [ 697.790345] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40ffece-b7ec-436b-a9b9-603ca8f67c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.790811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.790811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.790881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.791654] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.791654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.791654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.791654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.791654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.791654] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a40ffece-b7ec-436b-a9b9-603ca8f67c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.295567] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.295773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.295827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.296132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.296206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.296545] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.296545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.296545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.296746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.297132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.297132] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 is going to be updated. [ 698.334735] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.334927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.335814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.335814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.335940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.349092] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 in Status: IN_PROGRESS for 2s [ 698.656362] env[65788]: INFO networking_nsxv3.common.synchronization [None req-9b181329-fe92-4a88-ae79-769465579bf7 None None] Enqueued Resource ID: 55b60d19-f829-41bb-995e-a4cbd7a76f34 with Priority: HIGHEST for action port [ 698.657032] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b60d19-f829-41bb-995e-a4cbd7a76f34 with Priority: HIGHEST for action port [ 698.657460] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-55b60d19-f829-41bb-995e-a4cbd7a76f34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.657604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55b60d19-f829-41bb-995e-a4cbd7a76f34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.657708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55b60d19-f829-41bb-995e-a4cbd7a76f34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.657974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55b60d19-f829-41bb-995e-a4cbd7a76f34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.658126] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55b60d19-f829-41bb-995e-a4cbd7a76f34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.671023] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 in Status: SUCCESS [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.671023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.671023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.671023] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.161803] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55b60d19-f829-41bb-995e-a4cbd7a76f34 [ 699.162157] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.162234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.162372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.162612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.162740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.162855] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55b60d19-f829-41bb-995e-a4cbd7a76f34 already deleted. [ 699.162942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55b60d19-f829-41bb-995e-a4cbd7a76f34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.173577] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.173707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.173791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.173992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.174174] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.174296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.174352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.174480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.174561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.174642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.174785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.174872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.174931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.175101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.175243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.175332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.175389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.175521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.175591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.175668] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.175752] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.678279] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e24ba33-cda5-495d-82c8-aa68e5d0b507: rpc.has_security_group_logging(os_id): False [ 699.696192] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.696345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.696425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.696618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.696706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.696917] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.697031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.697087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.697248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.697308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.697493] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.697586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.697645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.697778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.697852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.698046] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.698131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.698190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.698327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.698403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.698491] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 is going to be created. [ 699.794741] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.794741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.794741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.794741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.794741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.809426] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 in Status: IN_PROGRESS for 2s [ 700.361032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 in Status: SUCCESS [ 700.361375] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40ffece-b7ec-436b-a9b9-603ca8f67c90 deletion is rescheduled due to dependency. [ 700.361375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40ffece-b7ec-436b-a9b9-603ca8f67c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.828615] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 in Status: SUCCESS [ 701.829023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.233752] env[65788]: INFO networking_nsxv3.common.synchronization [None req-4e68656a-55fa-4cf2-a33a-b58e43a01025 tempest-MigrationsAdminTest-390226756 tempest-MigrationsAdminTest-390226756-project-member] Enqueued Resource ID: ab8a37e8-67d6-4fbe-8945-7f4cc400106c with Priority: HIGHEST for action security_group_rules [ 702.234629] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8a37e8-67d6-4fbe-8945-7f4cc400106c with Priority: HIGHEST for action security_group_rules [ 702.235283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.235528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.235677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.236135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.236416] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8a37e8-67d6-4fbe-8945-7f4cc400106c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.359960] env[65788]: INFO networking_nsxv3.common.synchronization [None req-73800a20-2338-46c2-bfc7-286dbf105ac7 tempest-MigrationsAdminTest-390226756 tempest-MigrationsAdminTest-390226756-project-member] Enqueued Resource ID: ab8a37e8-67d6-4fbe-8945-7f4cc400106c with Priority: HIGHEST for action security_group_rules [ 702.359960] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8a37e8-67d6-4fbe-8945-7f4cc400106c with Priority: HIGHEST for action security_group_rules [ 702.359960] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.360593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.758506] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.758697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.758781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.759134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.759306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.759507] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8a37e8-67d6-4fbe-8945-7f4cc400106c already deleted. [ 702.759605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.759851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.760095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.760150] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8a37e8-67d6-4fbe-8945-7f4cc400106c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.289402] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.289708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.289708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.290450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.290744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.290744] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8a37e8-67d6-4fbe-8945-7f4cc400106c already deleted. [ 703.290919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8a37e8-67d6-4fbe-8945-7f4cc400106c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.313265] env[65788]: INFO networking_nsxv3.common.synchronization [req-ca95215e-5be9-4e78-88d2-99ef8937b3b4 req-10f5437d-944a-464c-90f9-898f4e11e092 tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 703.313839] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 703.314187] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.314312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.314382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.315833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.316060] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.316204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.316271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.316450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.316556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.316677] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.821660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.821881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.821948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.822316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.822429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.822551] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.822652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.822710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.822869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.823048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.823048] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf already deleted. [ 703.823137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.930576] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.930769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.930863] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.931552] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.931552] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.931830] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.931830] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.931957] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.933248] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.933901] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.933901] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.933901] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.933901] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.934110] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.934110] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.934579] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.957543] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.957871] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.958093] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.958507] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.958884] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.959082] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.959223] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.959548] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.959685] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5a3c59-21b6-4d6d-bd50-8069c24e7348',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.462822] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.463232] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.463232] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.467038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.467038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.467038] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 2f5a3c59-21b6-4d6d-bd50-8069c24e7348 not found, creating... [ 704.467038] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.467038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.467038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.467038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.467038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.467038] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.467038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.467671] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.467671] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.467671] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.467671] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 2f5a3c59-21b6-4d6d-bd50-8069c24e7348 is going to be created. [ 704.498702] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.498990] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.499212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.499490] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.499723] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.499940] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.061098] env[65788]: INFO networking_nsxv3.common.synchronization [req-10ecbf84-ad3e-4bf0-b5a6-02d057bca58e req-3d7a8219-f42f-4ff4-a032-23eb7bdc8c92 tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 705.061889] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 705.062918] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.063100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.063178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.063386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.063560] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.063663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.063856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.063856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.063942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.064050] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.238193] env[65788]: INFO networking_nsxv3.common.synchronization [req-ca95215e-5be9-4e78-88d2-99ef8937b3b4 req-37fc569f-82c8-4fa1-97af-640fce621b9a service nova] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 705.238376] env[65788]: INFO networking_nsxv3.common.synchronization [req-ca95215e-5be9-4e78-88d2-99ef8937b3b4 req-37fc569f-82c8-4fa1-97af-640fce621b9a service nova] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 705.238505] env[65788]: INFO networking_nsxv3.common.synchronization [req-ca95215e-5be9-4e78-88d2-99ef8937b3b4 req-37fc569f-82c8-4fa1-97af-640fce621b9a service nova] Enqueued Resource ID: 2f5a3c59-21b6-4d6d-bd50-8069c24e7348 with Priority: HIGHEST for action port [ 705.238735] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 705.238866] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 705.239017] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5a3c59-21b6-4d6d-bd50-8069c24e7348 with Priority: HIGHEST for action port [ 705.239582] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.239724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.239857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.239988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.241123] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.241330] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.241330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.241330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.241484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.241641] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.241730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.242742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.242742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.242742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.242742] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.242895] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.244708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.244708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.244708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.244804] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5a3c59-21b6-4d6d-bd50-8069c24e7348',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.247437] env[65788]: INFO networking_nsxv3.common.synchronization [req-649de3be-de84-4c03-a749-746552a04b4a req-3126f248-f4a0-4a38-aa07-67677efa7a95 tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 705.248660] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 705.248744] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.248923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.249053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.249605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.249605] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.249776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.249829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.250104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.250401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.250554] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.565566] env[65788]: INFO networking_nsxv3.common.synchronization [req-312a1afa-6a40-47ca-bc36-5578cbb39c6c req-52faf249-37ba-42fb-9206-3cc6bc225bca tempest-InstanceActionsV221TestJSON-877900018 tempest-InstanceActionsV221TestJSON-877900018-project-member] Enqueued Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_members [ 705.566386] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGHEST for action security_group_members [ 705.566485] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.566612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.566681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.566911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.567023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.567289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.567429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.567513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.567700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.567809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.568027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 705.569169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.569328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.569422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.569642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.569829] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.569961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.570057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.570242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.570357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.570479] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.608566] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.608741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.608808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.608998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.609189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.619498] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 705.750056] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.750056] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.750056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.750056] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f5a3c59-21b6-4d6d-bd50-8069c24e7348 with status ACTIVE [ 705.750056] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.750056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.750056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.750056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.750056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.750056] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.750056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.750056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.750690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.750878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.751245] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.751510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.751661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.752011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.752241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.752420] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f5a3c59-21b6-4d6d-bd50-8069c24e7348 is going to be updated. [ 705.754856] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.755272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.755476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.755750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.755932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.756258] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.756551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.756698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.756989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.757177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.757371] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be updated. [ 705.808967] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.810475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.810475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.810475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.810475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.810475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f5a3c59-21b6-4d6d-bd50-8069c24e7348" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.814911] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.816674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.816674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.816674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.816674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.826788] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 706.021835] env[65788]: INFO networking_nsxv3.common.synchronization [req-2288fa14-db47-4436-9255-5952136e0426 req-66e4e502-bc97-4ebf-8c13-07054356a506 tempest-ServersTestBootFromVolume-728581813 tempest-ServersTestBootFromVolume-728581813-project-member] Enqueued Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_members [ 706.021835] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_members [ 706.021835] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1723657c-045d-4e76-905a-f1602b6cbec4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.021835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.021835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.021835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.021835] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.021835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.021835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.021835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.021835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.021835] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.075477] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.075477] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.075477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.075477] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 is going to be updated. [ 706.105024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.105024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.105024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.105024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.105024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.115822] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 in Status: IN_PROGRESS for 2s [ 706.256384] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.414234] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.414411] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-786" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.414527] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-786" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.414868] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-786" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.415132] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.415284] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.415398] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.415669] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.415808] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.416056] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.416167] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.416355] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.416726] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.416869] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.416976] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.417117] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.436649] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.436804] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.436938] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.437141] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-786" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.437461] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-b06ad907-b947-4211-a772-9451be251c9c taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.437632] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.437744] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.438086] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.438222] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b06ad907-b947-4211-a772-9451be251c9c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.524518] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.524591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.524642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.526262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.526314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.526528] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.528013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.528013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.528013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.528013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.528013] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1723657c-045d-4e76-905a-f1602b6cbec4 already deleted. [ 706.528013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.759387] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.759387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.759387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.759806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.759806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.759806] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf is going to be created. [ 706.795178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.795429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.795429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.795661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.795833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.807335] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: UNINITIALIZED for 2s [ 706.923166] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3f21938e-46e7-48ab-a623-f79af3fc835a None None] Enqueued Resource ID: 52f7d5fc-dd91-44fa-8209-371b993b3856 with Priority: HIGHEST for action port [ 706.923423] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f7d5fc-dd91-44fa-8209-371b993b3856 with Priority: HIGHEST for action port [ 706.924373] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f7d5fc-dd91-44fa-8209-371b993b3856 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.924505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f7d5fc-dd91-44fa-8209-371b993b3856" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.924574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f7d5fc-dd91-44fa-8209-371b993b3856" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.924833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f7d5fc-dd91-44fa-8209-371b993b3856" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.924918] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f7d5fc-dd91-44fa-8209-371b993b3856',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.941194] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.941417] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.941539] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.941804] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.941979] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.942116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port b06ad907-b947-4211-a772-9451be251c9c not found, creating... [ 706.942436] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.942599] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.942711] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.942934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.943146] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.943472] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.943622] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.943733] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.943935] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.944078] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.944215] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: b06ad907-b947-4211-a772-9451be251c9c is going to be created. [ 706.964436] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.964637] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.964700] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.964959] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.965193] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.965410] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.426578] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52f7d5fc-dd91-44fa-8209-371b993b3856 [ 707.426813] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.428354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.428354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.428354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.428354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.428354] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52f7d5fc-dd91-44fa-8209-371b993b3856 already deleted. [ 707.428354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f7d5fc-dd91-44fa-8209-371b993b3856" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.629588] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 707.629800] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 707.629903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.735667] env[65788]: INFO networking_nsxv3.common.synchronization [req-2288fa14-db47-4436-9255-5952136e0426 req-56317885-85f8-486a-940f-73882780a8ba service nova] Enqueued Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_rules [ 707.735839] env[65788]: INFO networking_nsxv3.common.synchronization [req-2288fa14-db47-4436-9255-5952136e0426 req-56317885-85f8-486a-940f-73882780a8ba service nova] Enqueued Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_members [ 707.735970] env[65788]: INFO networking_nsxv3.common.synchronization [req-2288fa14-db47-4436-9255-5952136e0426 req-56317885-85f8-486a-940f-73882780a8ba service nova] Enqueued Resource ID: b06ad907-b947-4211-a772-9451be251c9c with Priority: HIGHEST for action port [ 707.736549] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_rules [ 707.736877] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_members [ 707.736877] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b06ad907-b947-4211-a772-9451be251c9c with Priority: HIGHEST for action port [ 707.738704] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1723657c-045d-4e76-905a-f1602b6cbec4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.739527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.739527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.739527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.739654] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.740986] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1723657c-045d-4e76-905a-f1602b6cbec4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.741177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.741219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.742492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.742689] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.742828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.742903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.743284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.743327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.743706] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.746573] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b06ad907-b947-4211-a772-9451be251c9c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.746714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.746842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.747026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.747122] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b06ad907-b947-4211-a772-9451be251c9c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.840389] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 707.841052] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e deletion is rescheduled due to dependency. [ 707.841052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.129071] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 in Status: SUCCESS [ 708.129071] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 deletion is rescheduled due to dependency. [ 708.129388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.249546] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1723657c-045d-4e76-905a-f1602b6cbec4 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.252465] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.252465] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b06ad907-b947-4211-a772-9451be251c9c with status ACTIVE [ 708.252465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.252465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.252465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.253349] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.253622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.253810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.254090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.254330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.254669] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b06ad907-b947-4211-a772-9451be251c9c is going to be updated. [ 708.283506] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.283506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.283506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.283506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.283506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.283757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b06ad907-b947-4211-a772-9451be251c9c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.560504] env[65788]: INFO networking_nsxv3.common.synchronization [req-f49d087c-6b24-43fd-93ca-69b80437a077 req-57274bf1-2995-4b19-b8e5-6c902ed7d499 tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 708.560677] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 708.561819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.561819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.561819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.561819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.561819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.561819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.561819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.562224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.562224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.562481] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.757181] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.819797] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: SUCCESS [ 708.819797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.820758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.821274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.822326] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.822326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.822326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.822326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.822326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.822326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.826110] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.063909] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.064270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.064324] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.064629] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.065045] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.065266] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.065431] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.065734] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.065931] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.066295] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.066471] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.066638] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.066890] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.067075] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.067225] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.067414] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.070112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.070240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.070322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.070509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.070598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.070798] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.070927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.070993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.071139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.071221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.071308] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 471c938d-6085-49dc-9e65-e361b495b859 already deleted. [ 709.071388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.093728] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.093916] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.094113] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.094256] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.094583] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-7c95e43b-a067-4b6d-a262-55786d6a22d4 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.094743] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.094890] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.095271] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.095355] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c95e43b-a067-4b6d-a262-55786d6a22d4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.262355] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.262557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.262648] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.262874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.262968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.263107] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1723657c-045d-4e76-905a-f1602b6cbec4 is going to be created. [ 709.271841] env[65788]: INFO networking_nsxv3.common.synchronization [None req-98db9a2a-2fc5-4ae7-aa64-9766236992ab None None] Enqueued Resource ID: a56698b4-f490-4305-b95b-d966f2206ee7 with Priority: HIGHEST for action port [ 709.272938] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56698b4-f490-4305-b95b-d966f2206ee7 with Priority: HIGHEST for action port [ 709.272938] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a56698b4-f490-4305-b95b-d966f2206ee7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.273201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a56698b4-f490-4305-b95b-d966f2206ee7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.273201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a56698b4-f490-4305-b95b-d966f2206ee7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.273465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a56698b4-f490-4305-b95b-d966f2206ee7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.273560] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56698b4-f490-4305-b95b-d966f2206ee7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.293548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.293751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.293859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.294243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.294537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.307198] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1723657c-045d-4e76-905a-f1602b6cbec4 in Status: UNINITIALIZED for 2s [ 709.327532] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.597517] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.597791] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.597848] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.598338] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.598338] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.598435] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 7c95e43b-a067-4b6d-a262-55786d6a22d4 not found, creating... [ 709.598836] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.598836] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.599042] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.599247] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.599247] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.599579] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.599742] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.599863] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.600065] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.600428] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.600428] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 7c95e43b-a067-4b6d-a262-55786d6a22d4 is going to be created. [ 709.623927] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.624742] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.625044] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.625727] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.625727] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.626613] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.775687] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a56698b4-f490-4305-b95b-d966f2206ee7 [ 709.776077] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.776495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.776495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.776749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.776905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.777060] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a56698b4-f490-4305-b95b-d966f2206ee7 already deleted. [ 709.777210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a56698b4-f490-4305-b95b-d966f2206ee7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.831361] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf: rpc.has_security_group_logging(os_id): False [ 709.850661] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.850850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.850850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.851318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.851749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.851846] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.851958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.852378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.852378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.852537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.852619] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf is going to be created. [ 709.921059] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.921059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.921059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.921059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.921059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.933340] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: IN_PROGRESS for 2s [ 710.343543] env[65788]: INFO networking_nsxv3.common.synchronization [req-f49d087c-6b24-43fd-93ca-69b80437a077 req-b3e0132d-49a8-43dc-90ab-5258bf581269 service nova] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_rules [ 710.343543] env[65788]: INFO networking_nsxv3.common.synchronization [req-f49d087c-6b24-43fd-93ca-69b80437a077 req-b3e0132d-49a8-43dc-90ab-5258bf581269 service nova] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 710.343543] env[65788]: INFO networking_nsxv3.common.synchronization [req-f49d087c-6b24-43fd-93ca-69b80437a077 req-b3e0132d-49a8-43dc-90ab-5258bf581269 service nova] Enqueued Resource ID: 7c95e43b-a067-4b6d-a262-55786d6a22d4 with Priority: HIGHEST for action port [ 710.343543] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_rules [ 710.343543] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 710.343543] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c95e43b-a067-4b6d-a262-55786d6a22d4 with Priority: HIGHEST for action port [ 710.343543] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.343543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.343543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.344190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.344190] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.344531] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.344731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.344731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.344895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.345018] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.345137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.345208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.345332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.345415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.345504] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.349084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c95e43b-a067-4b6d-a262-55786d6a22d4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.349276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.349276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.349479] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.349479] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c95e43b-a067-4b6d-a262-55786d6a22d4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.852081] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.853948] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.854325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.854419] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c95e43b-a067-4b6d-a262-55786d6a22d4 with status ACTIVE [ 710.854899] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.859036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.859036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.859036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.859036] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c95e43b-a067-4b6d-a262-55786d6a22d4 is going to be updated. [ 710.889072] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.889269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.889310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.889547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.889724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.889907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c95e43b-a067-4b6d-a262-55786d6a22d4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.254373] env[65788]: INFO networking_nsxv3.common.synchronization [req-795807bf-4ccd-4269-87e2-6b724f0eb180 req-9fd7f1e4-e856-4784-9bc1-7635c1e8a9d8 tempest-ServerMetadataTestJSON-1602187725 tempest-ServerMetadataTestJSON-1602187725-project-member] Enqueued Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_members [ 711.257886] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 with Priority: HIGHEST for action security_group_members [ 711.258707] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-60331e89-d7f7-4118-84ff-3c2694ae8888 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.258877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.258988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.259195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.259400] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.259531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.259614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.259796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.259876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.259983] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60331e89-d7f7-4118-84ff-3c2694ae8888',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.320661] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1723657c-045d-4e76-905a-f1602b6cbec4 in Status: SUCCESS [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.320661] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.320661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.320661] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.362050] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.530594] env[65788]: INFO networking_nsxv3.common.synchronization [None req-754d86e0-9db0-4550-a1a6-ecb4c63c54e8 None None] Enqueued Resource ID: ade31b68-d155-4815-87cb-758215925d3a with Priority: HIGHEST for action port [ 711.531168] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade31b68-d155-4815-87cb-758215925d3a with Priority: HIGHEST for action port [ 711.531572] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ade31b68-d155-4815-87cb-758215925d3a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.532646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ade31b68-d155-4815-87cb-758215925d3a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.532646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ade31b68-d155-4815-87cb-758215925d3a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.534083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ade31b68-d155-4815-87cb-758215925d3a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.534878] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ade31b68-d155-4815-87cb-758215925d3a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.764074] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.764074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.764074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.764074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.764074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.764576] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.764576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.764576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.764576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.764576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.764715] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 is going to be updated. [ 711.797941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.797941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.798050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.798387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.798387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.809894] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 in Status: IN_PROGRESS for 2s [ 711.823545] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.865890] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.866084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.866157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.866334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.866493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.866579] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be created. [ 711.892478] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.892738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.892738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.893045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.893533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.904873] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: UNINITIALIZED for 2s [ 711.946726] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: SUCCESS [ 711.947280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.039638] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ade31b68-d155-4815-87cb-758215925d3a [ 712.042094] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.042094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.042094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.042094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.042094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.042094] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ade31b68-d155-4815-87cb-758215925d3a already deleted. [ 712.042094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ade31b68-d155-4815-87cb-758215925d3a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.085154] env[65788]: INFO networking_nsxv3.common.synchronization [req-97801b00-77f3-4520-aac8-7dd07a5fe81e req-a5511221-46e1-4d5a-985f-a8b9e745cbf5 tempest-ServersV294TestFqdnHostnames-200598053 tempest-ServersV294TestFqdnHostnames-200598053-project-member] Enqueued Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_members [ 712.088396] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_members [ 712.088396] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.088396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.088396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.088396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.088396] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.088396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.088396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.088396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.088396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.088396] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.329382] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1723657c-045d-4e76-905a-f1602b6cbec4: rpc.has_security_group_logging(os_id): False [ 712.347752] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.348116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.348300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.349239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.349239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.349239] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.349239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.349239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.349466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.349466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.349466] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1723657c-045d-4e76-905a-f1602b6cbec4 is going to be created. [ 712.423492] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.423492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.423492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.423863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.423863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.438656] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1723657c-045d-4e76-905a-f1602b6cbec4 in Status: IN_PROGRESS for 2s [ 712.492652] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.492922] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-915" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.493095] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-915" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.493481] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-915" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.493764] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.493962] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.494117] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.494396] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.494538] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.494765] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.494912] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.495036] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.495174] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.495301] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.495432] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.495572] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.515605] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.515784] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.515891] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.516080] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-915" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.516402] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-0bca079c-8bcd-4ff1-a17b-d235899de9e6 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.516814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.516814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.517036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.517167] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bca079c-8bcd-4ff1-a17b-d235899de9e6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.589455] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.589630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.589698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.589955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.590069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.590271] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.590384] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.590445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.590853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.590853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.590853] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 already deleted. [ 712.590853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.019222] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.019463] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.019583] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.022668] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.022668] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.022668] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 0bca079c-8bcd-4ff1-a17b-d235899de9e6 not found, creating... [ 713.022668] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.022668] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.022668] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.022668] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.022668] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.022668] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.022668] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.023060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.023060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.023060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.023060] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 0bca079c-8bcd-4ff1-a17b-d235899de9e6 is going to be created. [ 713.041828] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.042034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.042160] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.042431] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.042649] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.042866] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.797284] env[65788]: INFO networking_nsxv3.common.synchronization [req-97801b00-77f3-4520-aac8-7dd07a5fe81e req-172e3d6b-202c-4d5d-abcf-dab89260585c service nova] Enqueued Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_rules [ 713.797520] env[65788]: INFO networking_nsxv3.common.synchronization [req-97801b00-77f3-4520-aac8-7dd07a5fe81e req-172e3d6b-202c-4d5d-abcf-dab89260585c service nova] Enqueued Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_members [ 713.797604] env[65788]: INFO networking_nsxv3.common.synchronization [req-97801b00-77f3-4520-aac8-7dd07a5fe81e req-172e3d6b-202c-4d5d-abcf-dab89260585c service nova] Enqueued Resource ID: 0bca079c-8bcd-4ff1-a17b-d235899de9e6 with Priority: HIGHEST for action port [ 713.798164] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_rules [ 713.798304] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_members [ 713.799291] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bca079c-8bcd-4ff1-a17b-d235899de9e6 with Priority: HIGHEST for action port [ 713.799774] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.799906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.800017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.800584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.800584] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.802643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.803080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.803167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.803394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.805491] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.805491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.805491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.805491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.805491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.805491] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.805491] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bca079c-8bcd-4ff1-a17b-d235899de9e6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.805491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.805491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.805491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.805491] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bca079c-8bcd-4ff1-a17b-d235899de9e6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.815692] env[65788]: INFO networking_nsxv3.common.synchronization [None req-2ab9be9d-fe3f-4b3b-8e6c-709ae1c8473a None None] Enqueued Resource ID: 35ae4d0a-ce6a-4565-ae99-7e55d2454957 with Priority: HIGHEST for action port [ 713.817338] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35ae4d0a-ce6a-4565-ae99-7e55d2454957 with Priority: HIGHEST for action port [ 713.818239] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-35ae4d0a-ce6a-4565-ae99-7e55d2454957 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.818646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35ae4d0a-ce6a-4565-ae99-7e55d2454957" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.819824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35ae4d0a-ce6a-4565-ae99-7e55d2454957" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.820252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35ae4d0a-ce6a-4565-ae99-7e55d2454957" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.820467] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35ae4d0a-ce6a-4565-ae99-7e55d2454957',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.827649] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 in Status: SUCCESS [ 713.829359] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60331e89-d7f7-4118-84ff-3c2694ae8888 deletion is rescheduled due to dependency. [ 713.829359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60331e89-d7f7-4118-84ff-3c2694ae8888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.916069] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 713.916307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.916486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.916759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.916957] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.917089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.917161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.917310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.917393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.917484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.917977] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.307365] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.307487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.307677] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.308580] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bca079c-8bcd-4ff1-a17b-d235899de9e6 with status ACTIVE [ 714.308761] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.308871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.308937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.309164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.309245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.309415] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.309505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.309602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.310076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.310156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.312791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.312791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.312791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.312791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.313082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.313082] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bca079c-8bcd-4ff1-a17b-d235899de9e6 is going to be updated. [ 714.328110] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35ae4d0a-ce6a-4565-ae99-7e55d2454957 [ 714.328110] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.328252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.328252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.328423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.328506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.328601] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35ae4d0a-ce6a-4565-ae99-7e55d2454957 already deleted. [ 714.328675] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35ae4d0a-ce6a-4565-ae99-7e55d2454957" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.336376] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.336982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.336982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.337088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.337243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.337653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bca079c-8bcd-4ff1-a17b-d235899de9e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.386387] env[65788]: INFO networking_nsxv3.common.synchronization [req-a141f844-2b07-44f4-8f67-17484135c78f req-ad2005a6-67c2-4e61-a53a-e6482a594049 tempest-ImagesNegativeTestJSON-86089785 tempest-ImagesNegativeTestJSON-86089785-project-member] Enqueued Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_members [ 714.386387] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_members [ 714.387010] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e122c7c-4854-48e9-8b30-d71e6fb4283b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.387357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.387595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.387965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.388249] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.388507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.388768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.389061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.389241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.389447] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.422859] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.422859] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.422859] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.422859] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.422859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.423506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.423506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.423506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.423506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.423506] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.460714] env[65788]: INFO networking_nsxv3.common.synchronization [None req-a7f99b14-74d7-481b-bf0a-87f31e9fe577 None None] Enqueued Resource ID: 12f7cf22-bf4b-4b3e-8d0f-199e325c9257 with Priority: HIGHEST for action port [ 714.460714] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f7cf22-bf4b-4b3e-8d0f-199e325c9257 with Priority: HIGHEST for action port [ 714.460714] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-12f7cf22-bf4b-4b3e-8d0f-199e325c9257 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.460714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12f7cf22-bf4b-4b3e-8d0f-199e325c9257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.461077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12f7cf22-bf4b-4b3e-8d0f-199e325c9257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.461433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12f7cf22-bf4b-4b3e-8d0f-199e325c9257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.461525] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f7cf22-bf4b-4b3e-8d0f-199e325c9257',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.464013] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1723657c-045d-4e76-905a-f1602b6cbec4 in Status: SUCCESS [ 714.464233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.782071] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.782071] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-166" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.782071] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-166" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.782071] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-166" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.782569] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.782822] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.782918] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.783204] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.783357] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.783587] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.783656] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.783754] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.783854] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.783954] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.784066] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.784193] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.809747] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.809747] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.809747] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.809747] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-166" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.809747] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.809747] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.809747] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.812567] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.812892] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.816052] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.892427] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.892864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.892957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.895322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.895322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.895322] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.895322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.895322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.895322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.895322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.895322] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b already deleted. [ 714.895624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.924937] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 471c938d-6085-49dc-9e65-e361b495b859: rpc.has_security_group_logging(os_id): False [ 714.946911] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.947234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.947234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.948195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.948195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.948337] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.948739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.948739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.948739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.949022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.949561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.949561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.949561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.949561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.949797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.949797] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.949891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.951633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.951633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.951633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.951633] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be created. [ 714.969311] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12f7cf22-bf4b-4b3e-8d0f-199e325c9257 [ 714.969590] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.969758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.969832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.970057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.970155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.970264] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12f7cf22-bf4b-4b3e-8d0f-199e325c9257 already deleted. [ 714.970386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12f7cf22-bf4b-4b3e-8d0f-199e325c9257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.013991] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.014229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.016028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.016028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.016028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.034395] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: IN_PROGRESS for 2s [ 715.317216] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.317445] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.317569] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.317845] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.317984] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.318187] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 not found, creating... [ 715.318400] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.318553] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.318662] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.318869] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.319036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.319359] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.319505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.319620] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.319850] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.319931] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.320587] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 is going to be created. [ 715.323561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.323674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.323742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.323900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.323978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.324078] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 is going to be created. [ 715.343861] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.344065] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.344297] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.345053] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.345053] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.345179] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.349968] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.350117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.350171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.350375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.350908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.360408] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 in Status: UNINITIALIZED for 2s [ 716.206582] env[65788]: INFO networking_nsxv3.common.synchronization [req-a141f844-2b07-44f4-8f67-17484135c78f req-08ae68fd-8a3a-4e34-8878-bfa5f335175b service nova] Enqueued Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_rules [ 716.206874] env[65788]: INFO networking_nsxv3.common.synchronization [req-a141f844-2b07-44f4-8f67-17484135c78f req-08ae68fd-8a3a-4e34-8878-bfa5f335175b service nova] Enqueued Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_members [ 716.206955] env[65788]: INFO networking_nsxv3.common.synchronization [req-a141f844-2b07-44f4-8f67-17484135c78f req-08ae68fd-8a3a-4e34-8878-bfa5f335175b service nova] Enqueued Resource ID: 4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 with Priority: HIGHEST for action port [ 716.212667] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_rules [ 716.212667] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_members [ 716.212667] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 with Priority: HIGHEST for action port [ 716.212667] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e122c7c-4854-48e9-8b30-d71e6fb4283b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.212667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.212667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.212667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.212667] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.216832] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e122c7c-4854-48e9-8b30-d71e6fb4283b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.216832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.216832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.216832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.217677] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.217677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.217677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.217806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.217806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.217884] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.222471] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.222646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.222732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.223275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.223275] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.440708] env[65788]: INFO networking_nsxv3.common.synchronization [None req-0d7b5a1e-95da-47be-bc57-c9f96300234a None None] Enqueued Resource ID: a590f7b4-7565-4129-b0d9-f31b342d8f57 with Priority: HIGHEST for action port [ 716.441878] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a590f7b4-7565-4129-b0d9-f31b342d8f57 with Priority: HIGHEST for action port [ 716.442279] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a590f7b4-7565-4129-b0d9-f31b342d8f57 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.442409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a590f7b4-7565-4129-b0d9-f31b342d8f57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.442478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a590f7b4-7565-4129-b0d9-f31b342d8f57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.442752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a590f7b4-7565-4129-b0d9-f31b342d8f57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.442822] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a590f7b4-7565-4129-b0d9-f31b342d8f57',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.716206] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e122c7c-4854-48e9-8b30-d71e6fb4283b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.716206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.723408] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.727224] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 with status ACTIVE [ 716.729282] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.729282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.729282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.729534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.729572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.729809] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.729933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.730053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.730297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.730417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.730990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.730990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.730990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.731260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.731350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.731464] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26 is going to be updated. [ 716.761834] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.761834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.761834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.762089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.762147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.762553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d7c58e0-db34-4ea1-a6d7-85ad02c5fb26" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.945271] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a590f7b4-7565-4129-b0d9-f31b342d8f57 [ 716.945510] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.945649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.945732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.945959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.946076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.946189] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a590f7b4-7565-4129-b0d9-f31b342d8f57 already deleted. [ 716.946267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a590f7b4-7565-4129-b0d9-f31b342d8f57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.052906] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 717.053347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.064668] env[65788]: INFO networking_nsxv3.common.synchronization [req-1bc4ae37-1581-4ca9-8a12-ecabd5a82668 req-6565b68f-cff3-4570-8c2f-2582124672d3 tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 717.065188] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 717.065529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.065849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.065849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.066027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.066117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.066207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.066257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.066407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.066506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.066864] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.227149] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.379157] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 in Status: SUCCESS [ 717.379387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.379561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.379788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.379991] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.380300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.380300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.380466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.380685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.380833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.380947] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.537462] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.537680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.537799] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.538072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.538463] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.538631] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.538782] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.539123] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.539458] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.539518] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.539648] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.539744] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.539831] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.539947] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.540060] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.540248] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.565901] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.566653] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.566653] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.566653] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.566811] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-40f08637-9ab8-4f31-a866-598e95c61a01 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.566889] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.566982] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.567325] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.567452] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f08637-9ab8-4f31-a866-598e95c61a01',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.568429] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.568903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.569052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.569243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.569448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.569657] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.569736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.569800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.570945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.570945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.570945] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 717.602627] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.602810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.602876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.603137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.603231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.616748] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 717.730076] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.730243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.730323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.730527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.730616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.730713] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b is going to be created. [ 717.758391] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.758542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.758622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.758858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.759181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.770893] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b in Status: UNINITIALIZED for 2s [ 717.884369] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.072300] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.072530] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.072966] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.072966] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.073136] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.073240] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 40f08637-9ab8-4f31-a866-598e95c61a01 not found, creating... [ 718.073578] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.073677] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.073863] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.074182] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.074182] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.074514] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.074514] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.074653] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.074773] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.074910] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.075298] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 40f08637-9ab8-4f31-a866-598e95c61a01 is going to be created. [ 718.097446] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.097690] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.097790] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.098431] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.098431] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.098541] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.388317] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for faee84c4-679f-4be6-b6c5-c5e48bba4528: rpc.has_security_group_logging(os_id): False [ 718.412462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.412462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.412462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.412719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.412719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.413174] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.413174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.413174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.413317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.413317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.413479] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 is going to be created. [ 718.481143] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.481314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.481386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.481600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.481783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.493340] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 in Status: IN_PROGRESS for 2s [ 718.975976] env[65788]: INFO networking_nsxv3.common.synchronization [req-1bc4ae37-1581-4ca9-8a12-ecabd5a82668 req-d2c9e908-5bf5-4887-ab62-93f71ead8a1a service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 718.976419] env[65788]: INFO networking_nsxv3.common.synchronization [req-1bc4ae37-1581-4ca9-8a12-ecabd5a82668 req-d2c9e908-5bf5-4887-ab62-93f71ead8a1a service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 718.976583] env[65788]: INFO networking_nsxv3.common.synchronization [req-1bc4ae37-1581-4ca9-8a12-ecabd5a82668 req-d2c9e908-5bf5-4887-ab62-93f71ead8a1a service nova] Enqueued Resource ID: 40f08637-9ab8-4f31-a866-598e95c61a01 with Priority: HIGHEST for action port [ 718.978019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 718.978019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 718.978644] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f08637-9ab8-4f31-a866-598e95c61a01 with Priority: HIGHEST for action port [ 718.979099] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.979272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.979404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.979709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.979709] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.980657] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.980791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.981039] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-40f08637-9ab8-4f31-a866-598e95c61a01 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.981237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.981322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.981537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.981827] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f08637-9ab8-4f31-a866-598e95c61a01',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.483973] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.486808] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40f08637-9ab8-4f31-a866-598e95c61a01 with status ACTIVE [ 719.486808] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.486808] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.486808] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.486808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.487412] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40f08637-9ab8-4f31-a866-598e95c61a01 is going to be updated. [ 719.512345] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.512695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.512695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.512786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.512894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.513179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40f08637-9ab8-4f31-a866-598e95c61a01" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.640345] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 719.640529] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 deletion is rescheduled due to dependency. [ 719.640652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.640879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.641057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.641383] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.641509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.641576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.641742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.642423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.642423] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.711224] env[65788]: INFO networking_nsxv3.common.synchronization [req-060785bd-904e-4dee-a817-e85172a71bcb req-3dfe14ba-d60d-428c-9538-f889550a0112 tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 719.711224] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 719.711224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.711598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.711849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.712237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.712509] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.712790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.713096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.713483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.713719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.713904] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.785030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b in Status: SUCCESS [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.785030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.785030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.785030] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.144068] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.144364] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.144544] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.144824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.145299] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.145517] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.145692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.145975] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.146168] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.146453] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.146582] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.146724] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.146891] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.147089] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.147260] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.147422] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.149180] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.170080] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.170263] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.170397] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.170559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.170872] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-627f4459-25bc-4219-b698-d026d9f07b03 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.171308] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.171308] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.172135] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.172135] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('627f4459-25bc-4219-b698-d026d9f07b03',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.216547] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.287395] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e122c7c-4854-48e9-8b30-d71e6fb4283b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.287561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.287638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.287854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.288035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.288132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.288195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.288344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.288430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.288519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.288662] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e122c7c-4854-48e9-8b30-d71e6fb4283b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.288753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.288809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.288949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.289112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.289204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.289257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.289395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.289472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.289550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.289638] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.507469] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 in Status: SUCCESS [ 720.507881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.652327] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.673988] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.674257] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.674387] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.674671] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.674811] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.674970] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 627f4459-25bc-4219-b698-d026d9f07b03 not found, creating... [ 720.675232] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.675435] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.675491] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.675727] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.675944] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.676164] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.676317] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.676427] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.676625] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.676749] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.676881] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 627f4459-25bc-4219-b698-d026d9f07b03 is going to be created. [ 720.698836] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.699132] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.699300] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.699608] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.700182] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.700543] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.719477] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.792427] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e122c7c-4854-48e9-8b30-d71e6fb4283b: rpc.has_security_group_logging(os_id): False [ 720.811360] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.811534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.811577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.811804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.811898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.812159] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.812288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.812357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.812517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.812597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.812787] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.812884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.812947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.813102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.813195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.813361] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.813457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.813519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.813658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.813736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.813827] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b is going to be created. [ 720.915114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.915114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.915114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.915114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.915114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.924640] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b in Status: IN_PROGRESS for 2s [ 721.155236] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.155467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.155527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.155736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.155826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.155924] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 721.186657] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.186657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.186657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.186879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.186927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.197171] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 721.223013] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.223013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.223013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.223013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.223013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.223013] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be updated. [ 721.266147] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.266795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.266795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.266993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.267155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.277631] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: IN_PROGRESS for 2s [ 721.396633] env[65788]: INFO networking_nsxv3.common.synchronization [req-060785bd-904e-4dee-a817-e85172a71bcb req-eb24d74f-bfc5-4d45-94d9-4b236f90a6ae service nova] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_rules [ 721.396814] env[65788]: INFO networking_nsxv3.common.synchronization [req-060785bd-904e-4dee-a817-e85172a71bcb req-eb24d74f-bfc5-4d45-94d9-4b236f90a6ae service nova] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 721.396945] env[65788]: INFO networking_nsxv3.common.synchronization [req-060785bd-904e-4dee-a817-e85172a71bcb req-eb24d74f-bfc5-4d45-94d9-4b236f90a6ae service nova] Enqueued Resource ID: 627f4459-25bc-4219-b698-d026d9f07b03 with Priority: HIGHEST for action port [ 721.397475] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_rules [ 721.397613] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 721.397709] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627f4459-25bc-4219-b698-d026d9f07b03 with Priority: HIGHEST for action port [ 721.398197] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.398197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.398197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.398383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.398473] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.399659] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.399766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.400087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-627f4459-25bc-4219-b698-d026d9f07b03 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.400087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.400087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.400266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.400338] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('627f4459-25bc-4219-b698-d026d9f07b03',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.905022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.905022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 627f4459-25bc-4219-b698-d026d9f07b03 with status ACTIVE [ 721.905022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.905022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.905022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.905022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.906219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.906219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.906219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.906219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.906219] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 627f4459-25bc-4219-b698-d026d9f07b03 is going to be updated. [ 721.932519] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.932519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.932519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.932519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.932519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.932519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-627f4459-25bc-4219-b698-d026d9f07b03" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.469402] env[65788]: INFO networking_nsxv3.common.synchronization [req-1571bcc3-cb8b-4e67-b9da-5c720031780c req-f0dcdfed-d73d-4141-8c44-d83bd6d79ec5 tempest-FloatingIPsAssociationTestJSON-899504544 tempest-FloatingIPsAssociationTestJSON-899504544-project-member] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 722.470365] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 722.471027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.471027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.471027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.471389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.471620] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.471771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.471860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.472092] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.472297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.473082] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.939467] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b in Status: SUCCESS [ 722.939708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.975526] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.010026] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.010026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.010026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.010632] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.011065] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.012707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.012707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.012707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.012707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.012707] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.012707] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.012707] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.012707] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.012707] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.012707] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.013447] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.033698] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.033698] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.033698] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.033698] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-233" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.033698] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.033938] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.033938] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.034366] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.034439] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac8238d-62b1-49b0-9adb-73a0df0ef2eb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.214866] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 723.214866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.214866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.214866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.215171] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.215272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.215272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.215458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.215514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.215562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.215653] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.289636] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 723.289884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.290077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.290304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.290499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.290611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.290673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.290818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.290896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.290990] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.478518] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.537195] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.537312] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.537412] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.537704] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.537879] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.538079] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port dac8238d-62b1-49b0-9adb-73a0df0ef2eb not found, creating... [ 723.538695] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.539163] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.539284] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.539692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.539897] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.540428] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.540539] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.540985] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.540985] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.541111] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.541740] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: dac8238d-62b1-49b0-9adb-73a0df0ef2eb is going to be created. [ 723.561726] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.561996] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.562152] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.562427] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.562662] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.562906] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.718825] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.719276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.719856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.722055] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.722055] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.722055] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.722055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.723754] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.793147] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.981242] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.981242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.981831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.981831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.981831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.981973] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 is going to be updated. [ 724.013984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.014224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.014292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.014586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.014786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.027970] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: IN_PROGRESS for 2s [ 724.226050] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482328ee-c8ae-447e-af1f-c321cd088282: rpc.has_security_group_logging(os_id): False [ 724.244507] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.244808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.244808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.245210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.245210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.245295] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.245348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.245643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.245643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.245643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.245821] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.245904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.245951] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.246230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.246230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.246511] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.246511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.246511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.246739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.246739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.247326] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 724.297483] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.317954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.318226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.318336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.318638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.318852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.332759] env[65788]: INFO networking_nsxv3.common.synchronization [req-1571bcc3-cb8b-4e67-b9da-5c720031780c req-61e3242d-f921-4e31-94af-fc448c55a828 service nova] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_rules [ 724.333032] env[65788]: INFO networking_nsxv3.common.synchronization [req-1571bcc3-cb8b-4e67-b9da-5c720031780c req-61e3242d-f921-4e31-94af-fc448c55a828 service nova] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 724.333213] env[65788]: INFO networking_nsxv3.common.synchronization [req-1571bcc3-cb8b-4e67-b9da-5c720031780c req-61e3242d-f921-4e31-94af-fc448c55a828 service nova] Enqueued Resource ID: dac8238d-62b1-49b0-9adb-73a0df0ef2eb with Priority: HIGHEST for action port [ 724.333945] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_rules [ 724.334576] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 724.334642] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac8238d-62b1-49b0-9adb-73a0df0ef2eb with Priority: HIGHEST for action port [ 724.335024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.335231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.335298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.335588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.335687] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.339173] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.339330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.339634] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.339766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.339863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.343807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.343928] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac8238d-62b1-49b0-9adb-73a0df0ef2eb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.346435] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 724.801610] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.801792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.801911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.802204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.802332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.802531] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be updated. [ 724.843367] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.843367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.843367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.843735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.843735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.845353] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.845353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.846227] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dac8238d-62b1-49b0-9adb-73a0df0ef2eb with status ACTIVE [ 724.846227] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.846347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.846347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.846538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.846633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.846806] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.846990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.846990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.847159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.847245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.847476] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.847541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.847607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.847747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.847834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.847982] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dac8238d-62b1-49b0-9adb-73a0df0ef2eb is going to be updated. [ 724.859449] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: IN_PROGRESS for 2s [ 724.872651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.872876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.872995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.873237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.873375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.873563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dac8238d-62b1-49b0-9adb-73a0df0ef2eb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.041960] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: SUCCESS [ 726.041960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.041960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.042602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.042602] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.042602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.042602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.042738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.042738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.042827] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.367088] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 726.367427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.547358] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.874218] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 726.875579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.875579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.875579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.877654] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.877654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.877654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.877654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.877881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.877881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.878074] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.049452] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.382508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.382673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.382851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.383113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.383311] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.383517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.383594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.383816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.383958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.384123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.384366] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.384497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.384574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.384725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.384869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.384963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.385041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.385183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.385263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.385346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.385437] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.555499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.555499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.555499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.555499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.555499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.555499] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 is going to be updated. [ 727.591375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.591571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.591627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.591884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.592878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.607257] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: IN_PROGRESS for 2s [ 727.888539] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 471c938d-6085-49dc-9e65-e361b495b859: rpc.has_security_group_logging(os_id): False [ 727.910127] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.910281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.910443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.910577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.911019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.911514] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.911655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.912594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.912908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.912908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.913206] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.913395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.913395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.913797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.913884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.914089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.914822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.914822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.914822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.914822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.914822] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be updated. [ 728.014312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.014503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.014583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.014807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.014956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.031217] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: IN_PROGRESS for 2s [ 728.144699] env[65788]: INFO networking_nsxv3.common.synchronization [req-6739c0e2-ebf4-4b37-ae58-272e7583d249 req-ab5c9e26-2deb-41c1-b204-e929732724f5 tempest-ServersAdminNegativeTestJSON-2035322777 tempest-ServersAdminNegativeTestJSON-2035322777-project-member] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 728.145435] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 728.146453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.146453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.146453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.146632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.146843] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.146944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.146944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.147123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.147218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.147318] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.651025] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.703461] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.703674] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.703836] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.704161] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.704539] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.704708] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.704822] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.705126] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.705301] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.705540] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.705682] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.705794] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.705930] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.706080] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.706296] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.706370] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.731164] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.731526] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.731745] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.732023] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.732569] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-41709379-aa47-4e0f-8fa0-9555e17f5433 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.733434] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.733434] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.733666] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.733893] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41709379-aa47-4e0f-8fa0-9555e17f5433',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.027189] env[65788]: INFO networking_nsxv3.common.synchronization [None req-a8227207-3b44-4b6e-b5f0-9e6bd538c8fe None None] Enqueued Resource ID: 56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27 with Priority: HIGHEST for action port [ 729.027398] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27 with Priority: HIGHEST for action port [ 729.027691] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.028116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.028116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.028225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.028464] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.154951] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.237332] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.237725] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.237877] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.238185] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.238355] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.238579] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 41709379-aa47-4e0f-8fa0-9555e17f5433 not found, creating... [ 729.238873] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.239049] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.239220] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.239437] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.239578] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.239869] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.241133] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.241358] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.241630] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.241776] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.241912] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 41709379-aa47-4e0f-8fa0-9555e17f5433 is going to be created. [ 729.265909] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.266211] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.266351] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.266630] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.266853] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.267203] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.531094] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27 [ 729.531488] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.531671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.532031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.532326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.532444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.532574] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27 already deleted. [ 729.532680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56eb3a58-4ba9-4b8b-8f73-5cd0a196eb27" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.621604] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: SUCCESS [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.621604] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.621604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.621604] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.658011] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.658208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.658252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.658580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.658672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.658962] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b is going to be updated. [ 729.687683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.687884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.687884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.688113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.688256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.699831] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: IN_PROGRESS for 2s [ 730.050208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 730.050431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.106052] env[65788]: INFO networking_nsxv3.common.synchronization [req-6739c0e2-ebf4-4b37-ae58-272e7583d249 req-1dbd68f9-ce99-4854-a571-e8d90efb885f service nova] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_rules [ 730.106052] env[65788]: INFO networking_nsxv3.common.synchronization [req-6739c0e2-ebf4-4b37-ae58-272e7583d249 req-1dbd68f9-ce99-4854-a571-e8d90efb885f service nova] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 730.106052] env[65788]: INFO networking_nsxv3.common.synchronization [req-6739c0e2-ebf4-4b37-ae58-272e7583d249 req-1dbd68f9-ce99-4854-a571-e8d90efb885f service nova] Enqueued Resource ID: 41709379-aa47-4e0f-8fa0-9555e17f5433 with Priority: HIGHEST for action port [ 730.106177] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_rules [ 730.106322] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 730.106441] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41709379-aa47-4e0f-8fa0-9555e17f5433 with Priority: HIGHEST for action port [ 730.106987] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.107435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.107435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.107435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.107569] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.108401] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.109374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.109374] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-41709379-aa47-4e0f-8fa0-9555e17f5433 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.109374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.109374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.109374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.109374] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41709379-aa47-4e0f-8fa0-9555e17f5433',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.122728] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.122824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.122889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.123121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.123427] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.123963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.124048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.124212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.124303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.124395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.124545] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.124641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.124701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.124842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.125039] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.125094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.125136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.125264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.125340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.125421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.125508] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.611141] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.611796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.611796] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41709379-aa47-4e0f-8fa0-9555e17f5433 with status ACTIVE [ 730.611796] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.611796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.612180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.612180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.612180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.612380] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.612491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.612659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.612716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.612781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.612979] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.613093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.613153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.613294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.613393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.613452] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41709379-aa47-4e0f-8fa0-9555e17f5433 is going to be updated. [ 730.629092] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e17bee3e-2368-47f5-851f-96deb4d04a56: rpc.has_security_group_logging(os_id): False [ 730.641618] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.641781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.641833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.642068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.642241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.642413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41709379-aa47-4e0f-8fa0-9555e17f5433" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.650759] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.650896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.650972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.651298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.651370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.651541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.651700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.651700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.651853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.651932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.652131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.652247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.652319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.652466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.652547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.652736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.652833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.652901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.653086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.653148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.653237] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 is going to be updated. [ 730.761384] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.761650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.761650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.763030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.763030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.782373] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: IN_PROGRESS for 2s [ 731.331906] env[65788]: INFO networking_nsxv3.common.synchronization [req-2d0398ba-98b7-412f-831b-91b81fb5294c req-120b8cee-5c42-4ab2-a8c6-a3e48ca072d0 tempest-VolumesAdminNegativeTest-618844079 tempest-VolumesAdminNegativeTest-618844079-project-member] Enqueued Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_members [ 731.332519] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_members [ 731.332819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.332958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.333039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.334563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.334753] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.334870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.334940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.335341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.335449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.335603] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.712777] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: SUCCESS [ 731.713126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.713126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.713245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.713420] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.713527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.713607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.713735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.713803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.714482] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.742109] env[65788]: INFO networking_nsxv3.common.synchronization [None req-36286378-b5e1-4778-b5b8-cc7a854ef910 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_rules [ 731.742693] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_rules [ 731.745064] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.745303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.745378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.745676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.745768] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.838591] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.838779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.838867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.839166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.839294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.839524] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.839662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.839736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.839963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.840072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.840163] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42357d17-1e70-4140-8be5-5413affdb68e already deleted. [ 731.840248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.937149] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.937497] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-586" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.937577] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-586" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.937874] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-586" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.938536] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.939090] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.939309] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.939714] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.940021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.940594] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.940795] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.940977] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.941158] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.941332] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.941618] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.941959] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.959761] env[65788]: INFO networking_nsxv3.common.synchronization [None req-fa5c48d4-cc20-4e77-be9f-bd9919940383 None None] Enqueued Resource ID: 41f10505-8792-49db-a8f9-7fb93215605b with Priority: HIGHEST for action port [ 731.960597] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41f10505-8792-49db-a8f9-7fb93215605b with Priority: HIGHEST for action port [ 731.960948] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-41f10505-8792-49db-a8f9-7fb93215605b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.961573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41f10505-8792-49db-a8f9-7fb93215605b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.961573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41f10505-8792-49db-a8f9-7fb93215605b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.961888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41f10505-8792-49db-a8f9-7fb93215605b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.962025] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41f10505-8792-49db-a8f9-7fb93215605b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.964052] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.964283] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.964473] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.964848] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-586" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.965320] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-a07526a1-9dae-455e-8f31-2ca11416cecd taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.965910] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.965910] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.966160] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.966370] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a07526a1-9dae-455e-8f31-2ca11416cecd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.209610] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b240606c-674b-4a7b-9f62-69ec7e1e688c None None] Enqueued Resource ID: de0e4e41-a8bd-4576-b276-7092da4dc510 with Priority: HIGHEST for action port [ 732.210935] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de0e4e41-a8bd-4576-b276-7092da4dc510 with Priority: HIGHEST for action port [ 732.210935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-de0e4e41-a8bd-4576-b276-7092da4dc510 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.210935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de0e4e41-a8bd-4576-b276-7092da4dc510" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.210935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de0e4e41-a8bd-4576-b276-7092da4dc510" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.211269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de0e4e41-a8bd-4576-b276-7092da4dc510" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.211269] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de0e4e41-a8bd-4576-b276-7092da4dc510',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.217579] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.271090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.271090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.271090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.271090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.271090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.271090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 already deleted. [ 732.271572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.469085] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41f10505-8792-49db-a8f9-7fb93215605b [ 732.469642] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.469858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.470114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.470355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.470506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.470656] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41f10505-8792-49db-a8f9-7fb93215605b already deleted. [ 732.470773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41f10505-8792-49db-a8f9-7fb93215605b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.471578] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.471909] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.472303] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.473793] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.474060] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.474328] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port a07526a1-9dae-455e-8f31-2ca11416cecd not found, creating... [ 732.474781] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.475058] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.475255] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.475596] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.475811] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.476306] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.476548] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.476779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.477099] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.477569] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.477755] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: a07526a1-9dae-455e-8f31-2ca11416cecd is going to be created. [ 732.504456] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.504762] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.504933] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505324] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505612] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.505892] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.719323] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de0e4e41-a8bd-4576-b276-7092da4dc510 [ 732.719323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.719323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.719323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.719861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.719861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.719861] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de0e4e41-a8bd-4576-b276-7092da4dc510 already deleted. [ 732.719861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de0e4e41-a8bd-4576-b276-7092da4dc510" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.720166] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.803567] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: SUCCESS [ 732.803810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.934756] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f8be28c6-b307-4590-9397-b6e7c5066972 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_rules [ 732.935649] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_rules [ 732.938147] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.938985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.938985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.939265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.939366] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.223311] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.223486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.223574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.223854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.223958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.224079] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b is going to be updated. [ 733.271506] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.271758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.271858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.272254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.272466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.289461] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: IN_PROGRESS for 2s [ 733.312764] env[65788]: INFO networking_nsxv3.common.synchronization [req-2d0398ba-98b7-412f-831b-91b81fb5294c req-130e5c16-8dbf-4fcc-853e-ef4edd744f37 service nova] Enqueued Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_rules [ 733.312818] env[65788]: INFO networking_nsxv3.common.synchronization [req-2d0398ba-98b7-412f-831b-91b81fb5294c req-130e5c16-8dbf-4fcc-853e-ef4edd744f37 service nova] Enqueued Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_members [ 733.315341] env[65788]: INFO networking_nsxv3.common.synchronization [req-2d0398ba-98b7-412f-831b-91b81fb5294c req-130e5c16-8dbf-4fcc-853e-ef4edd744f37 service nova] Enqueued Resource ID: a07526a1-9dae-455e-8f31-2ca11416cecd with Priority: HIGHEST for action port [ 733.315341] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_rules [ 733.315341] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_members [ 733.315341] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07526a1-9dae-455e-8f31-2ca11416cecd with Priority: HIGHEST for action port [ 733.315341] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.315341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.315341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.315341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.315341] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.315869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.316010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.316066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.316225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.316371] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.316617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.316617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.316878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.316878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.316878] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.322392] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a07526a1-9dae-455e-8f31-2ca11416cecd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.322532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.322597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.322808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.322884] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a07526a1-9dae-455e-8f31-2ca11416cecd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.461762] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.461999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.462127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.462478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.462621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.462762] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 already deleted. [ 733.462893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.578607] env[65788]: INFO networking_nsxv3.common.synchronization [req-c9164fbc-a4c1-4e92-86c9-5109865f1239 req-72022782-bcca-4325-b29a-74409845c02f tempest-ListServersNegativeTestJSON-1369105691 tempest-ListServersNegativeTestJSON-1369105691-project-member] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 733.580014] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 733.580014] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.580014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.580014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.580014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.580329] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.580329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.580329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.580478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.580973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.582030] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.826025] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.827813] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.827974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.828425] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a07526a1-9dae-455e-8f31-2ca11416cecd with status ACTIVE [ 733.828608] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.828736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.828804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.829542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.829542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.829542] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.829542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.829542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.829751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.829751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.829842] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.829898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.829954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.830120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.830240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.830240] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a07526a1-9dae-455e-8f31-2ca11416cecd is going to be updated. [ 733.856114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.857028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.857028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.857028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.857028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.857299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a07526a1-9dae-455e-8f31-2ca11416cecd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.054050] env[65788]: INFO networking_nsxv3.common.synchronization [req-b6dcba26-34f1-40cd-b133-7307677334be req-45b8a986-ea90-49fb-8e54-390c234a5c90 tempest-ListServersNegativeTestJSON-1369105691 tempest-ListServersNegativeTestJSON-1369105691-project-member] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 734.054823] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGHEST for action security_group_members [ 734.054895] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.054988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.085830] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.149555] env[65788]: INFO networking_nsxv3.common.synchronization [req-5a3b8396-04c9-4b3d-892b-8a574753d6b6 req-1d952537-cbc1-4b08-b617-255a956f3eeb tempest-ImagesNegativeTestJSON-86089785 tempest-ImagesNegativeTestJSON-86089785-project-member] Enqueued Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_members [ 734.152904] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b with Priority: HIGHEST for action security_group_members [ 734.152904] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e122c7c-4854-48e9-8b30-d71e6fb4283b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.152904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.152904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.152904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.152904] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.152904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.152904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.152904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.152904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.152904] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e122c7c-4854-48e9-8b30-d71e6fb4283b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.330304] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.588654] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.653715] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.653920] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.654012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.654338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.654504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.654781] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.654921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.655050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.655265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.655362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.655494] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b is going to be updated. [ 734.688986] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.688986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.688986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.688986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.688986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.698290] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b in Status: IN_PROGRESS for 2s [ 734.832566] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.832886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.832886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.833799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.833799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.834752] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42357d17-1e70-4140-8be5-5413affdb68e is going to be created. [ 734.857623] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ebbc1ee1-bdc4-49bf-8ad2-7ad75b16aea4 None None] Enqueued Resource ID: 5d495ebe-feaf-4f45-b47c-741c4a23ba62 with Priority: HIGHEST for action port [ 734.858785] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d495ebe-feaf-4f45-b47c-741c4a23ba62 with Priority: HIGHEST for action port [ 734.858785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d495ebe-feaf-4f45-b47c-741c4a23ba62 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.858785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d495ebe-feaf-4f45-b47c-741c4a23ba62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.858785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d495ebe-feaf-4f45-b47c-741c4a23ba62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.858785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d495ebe-feaf-4f45-b47c-741c4a23ba62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.859056] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d495ebe-feaf-4f45-b47c-741c4a23ba62',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.865950] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.866201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.867072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.867072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.867072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.882223] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42357d17-1e70-4140-8be5-5413affdb68e in Status: UNINITIALIZED for 2s [ 735.092422] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.092589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.092660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.092869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.093040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.093114] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 735.131681] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.131881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.131986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.132261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.133111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.143929] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 735.302048] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: SUCCESS [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.304989] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.304989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.304989] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.361981] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d495ebe-feaf-4f45-b47c-741c4a23ba62 [ 735.362278] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.362392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.362459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.362658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.362772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.362903] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d495ebe-feaf-4f45-b47c-741c4a23ba62 already deleted. [ 735.362998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d495ebe-feaf-4f45-b47c-741c4a23ba62" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.809604] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.810122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.810122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.810242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.811864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.811864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.811864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.811864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.812556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.812556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.812556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.812556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.812556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.812556] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.320741] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ea6710-254c-4bc8-955c-3558da8ea95b: rpc.has_security_group_logging(os_id): False [ 736.340177] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.340461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.340565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.340860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.340965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.341288] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.341416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.341488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.341650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.341733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.342162] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.342298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.342368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.342534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.342613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.342817] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.342914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.342977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.343140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.343217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.343304] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b is going to be updated. [ 736.414683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.414898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.414973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.415215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.415436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.428860] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: IN_PROGRESS for 2s [ 736.708697] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b in Status: SUCCESS [ 736.708810] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e122c7c-4854-48e9-8b30-d71e6fb4283b deletion is rescheduled due to dependency. [ 736.708849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e122c7c-4854-48e9-8b30-d71e6fb4283b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.893022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42357d17-1e70-4140-8be5-5413affdb68e in Status: SUCCESS [ 736.893486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.893780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.894103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.894418] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.895358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.895358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.895358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.895358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.895358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.895358] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.156685] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 737.157015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.157263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.157524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.157753] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.157891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.157981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.158203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.158411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.158608] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.397375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.397684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.397684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.398593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.398593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.398593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.398593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.398593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.398593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.398882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.398882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.399029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.399029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.399213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.400031] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.400031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.400031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.400031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.400031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.400031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.400031] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.661460] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.662171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.662370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.662596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.662695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.662915] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.663045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.663111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.663274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.663356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.664085] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be updated. [ 737.696213] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.696365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.696453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.696685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.696824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.709137] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: IN_PROGRESS for 2s [ 737.905289] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42357d17-1e70-4140-8be5-5413affdb68e: rpc.has_security_group_logging(os_id): False [ 737.926026] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.926294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.926443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.926894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.927181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.927436] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.927545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.927614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.927797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.927901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.929208] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.929411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.929473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.929706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.929796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.930084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.930234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.931106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.931861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.932067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.932214] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42357d17-1e70-4140-8be5-5413affdb68e is going to be created. [ 738.010169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.010408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.010469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.010712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.010958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.026131] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42357d17-1e70-4140-8be5-5413affdb68e in Status: IN_PROGRESS for 2s [ 738.446275] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: SUCCESS [ 738.446894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.610081] env[65788]: INFO networking_nsxv3.common.synchronization [None req-484cbb6d-4fd0-4796-a01c-a38666d818da tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 with Priority: HIGHEST for action security_group_rules [ 739.610582] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 with Priority: HIGHEST for action security_group_rules [ 739.610940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.613159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.614418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.614741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.614808] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a052cbf-6d98-474a-bf8e-cefa8a2c41a7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.686138] env[65788]: INFO networking_nsxv3.common.synchronization [None req-30826393-c45e-449f-90c3-60eb203a8823 None None] Enqueued Resource ID: dcc2b979-00a1-423d-8cb2-76d419d8527c with Priority: HIGHEST for action port [ 739.686138] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcc2b979-00a1-423d-8cb2-76d419d8527c with Priority: HIGHEST for action port [ 739.687894] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcc2b979-00a1-423d-8cb2-76d419d8527c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.687894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcc2b979-00a1-423d-8cb2-76d419d8527c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.687894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcc2b979-00a1-423d-8cb2-76d419d8527c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.687894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcc2b979-00a1-423d-8cb2-76d419d8527c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.687894] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcc2b979-00a1-423d-8cb2-76d419d8527c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.719314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 in Status: SUCCESS [ 739.719553] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 deletion is rescheduled due to dependency. [ 739.719594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.045592] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42357d17-1e70-4140-8be5-5413affdb68e in Status: SUCCESS [ 740.045592] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.112908] env[65788]: INFO networking_nsxv3.common.synchronization [None req-af14f580-d8f8-4c5f-9bae-6f5cdc624d6a tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 with Priority: HIGHEST for action security_group_rules [ 740.113551] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 with Priority: HIGHEST for action security_group_rules [ 740.114094] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.114730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.152403] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.152403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.152403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.152403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.152403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.152403] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 already deleted. [ 740.152403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.152403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.152403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.152403] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a052cbf-6d98-474a-bf8e-cefa8a2c41a7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.189479] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcc2b979-00a1-423d-8cb2-76d419d8527c [ 740.189719] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.189848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.189914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.190148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.190236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.190332] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcc2b979-00a1-423d-8cb2-76d419d8527c already deleted. [ 740.190410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcc2b979-00a1-423d-8cb2-76d419d8527c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.692627] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.692627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.694042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.694042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.694042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.694042] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a052cbf-6d98-474a-bf8e-cefa8a2c41a7 already deleted. [ 740.694042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a052cbf-6d98-474a-bf8e-cefa8a2c41a7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.458356] env[65788]: INFO networking_nsxv3.common.synchronization [None req-bd131abb-a1dd-4e9e-9b8f-f54bf7e44563 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 742.459013] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 742.462031] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.462161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.462325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.462461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.462793] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.671566] env[65788]: INFO networking_nsxv3.common.synchronization [None req-0f5123b8-0520-4d49-b753-369d230152b9 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 742.671566] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 742.671940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.672149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.000853] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.003488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.007235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.007235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.007235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.007235] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 already deleted. [ 743.007235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.007235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.007235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.007235] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.298472] env[65788]: INFO networking_nsxv3.common.synchronization [None req-01377e3f-ac4e-4aa1-96f9-696a292083ca None None] Enqueued Resource ID: 23435587-e382-4fd4-9e78-68c37a04b63c with Priority: HIGHEST for action port [ 743.299143] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23435587-e382-4fd4-9e78-68c37a04b63c with Priority: HIGHEST for action port [ 743.299473] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-23435587-e382-4fd4-9e78-68c37a04b63c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.299613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23435587-e382-4fd4-9e78-68c37a04b63c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.299770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23435587-e382-4fd4-9e78-68c37a04b63c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.299930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23435587-e382-4fd4-9e78-68c37a04b63c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.303063] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23435587-e382-4fd4-9e78-68c37a04b63c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.527997] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.528349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.528349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.528539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.528643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.528772] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 already deleted. [ 743.528847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.805244] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23435587-e382-4fd4-9e78-68c37a04b63c [ 743.805584] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.805683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.805683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.805904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.806012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.806116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23435587-e382-4fd4-9e78-68c37a04b63c already deleted. [ 743.806202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23435587-e382-4fd4-9e78-68c37a04b63c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.943805] env[65788]: INFO networking_nsxv3.common.synchronization [req-585919d3-893d-458f-9de3-b04221ea9e0f req-a8a73643-fc93-4a78-9865-7036800d6f9b tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 745.944904] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 745.945089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.945250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.945396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.945691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.945805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.946264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.946264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.946264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.946264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.946459] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.448872] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.936250] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.936433] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.936782] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.936834] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.937129] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.937302] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.937351] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.937515] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.937653] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.937858] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.937962] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.938210] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.938341] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.938443] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.938611] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.938666] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.952667] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.962389] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.962389] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.962389] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.962573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.965369] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.965581] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.965700] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.966062] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.966522] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d74e9b25-7fdc-4267-b1cb-16009a0c7d86',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.455131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.455286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.455355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.455584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.455678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.455798] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 747.469996] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.470294] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.470414] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.474020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.474020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.474020] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port d74e9b25-7fdc-4267-b1cb-16009a0c7d86 not found, creating... [ 747.474020] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.474020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.474020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.474020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.474020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.474020] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.474020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.474602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.474602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.474602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.474602] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: d74e9b25-7fdc-4267-b1cb-16009a0c7d86 is going to be created. [ 747.493815] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.493961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.494065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.494250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.494398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.496838] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.497017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.497147] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.497406] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.497627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.498012] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.536741] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 747.541053] env[65788]: INFO networking_nsxv3.common.synchronization [None req-8d3606be-34da-4eb3-a4a5-c4183995f5c6 None None] Enqueued Resource ID: 115b53c3-cb1a-43f9-bfab-d4f0e68af02d with Priority: HIGHEST for action port [ 747.541906] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115b53c3-cb1a-43f9-bfab-d4f0e68af02d with Priority: HIGHEST for action port [ 747.542147] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-115b53c3-cb1a-43f9-bfab-d4f0e68af02d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.542301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-115b53c3-cb1a-43f9-bfab-d4f0e68af02d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.542372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-115b53c3-cb1a-43f9-bfab-d4f0e68af02d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.542752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-115b53c3-cb1a-43f9-bfab-d4f0e68af02d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.542838] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('115b53c3-cb1a-43f9-bfab-d4f0e68af02d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.046922] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 115b53c3-cb1a-43f9-bfab-d4f0e68af02d [ 748.046922] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.046922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.046922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.046922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.046922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.046922] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:115b53c3-cb1a-43f9-bfab-d4f0e68af02d already deleted. [ 748.046922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-115b53c3-cb1a-43f9-bfab-d4f0e68af02d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.261586] env[65788]: INFO networking_nsxv3.common.synchronization [req-585919d3-893d-458f-9de3-b04221ea9e0f req-8b900b7d-53f9-49ee-8a8f-29039ce51697 service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 748.261586] env[65788]: INFO networking_nsxv3.common.synchronization [req-585919d3-893d-458f-9de3-b04221ea9e0f req-8b900b7d-53f9-49ee-8a8f-29039ce51697 service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 748.261586] env[65788]: INFO networking_nsxv3.common.synchronization [req-585919d3-893d-458f-9de3-b04221ea9e0f req-8b900b7d-53f9-49ee-8a8f-29039ce51697 service nova] Enqueued Resource ID: d74e9b25-7fdc-4267-b1cb-16009a0c7d86 with Priority: HIGHEST for action port [ 748.262895] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 748.263451] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 748.263451] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d74e9b25-7fdc-4267-b1cb-16009a0c7d86 with Priority: HIGHEST for action port [ 748.263632] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.263957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.263957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.264195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.264326] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.269024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.269024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.269024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.269024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.269024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.269024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.269024] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d74e9b25-7fdc-4267-b1cb-16009a0c7d86',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.772644] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.772644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.774299] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d74e9b25-7fdc-4267-b1cb-16009a0c7d86 with status ACTIVE [ 748.774689] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.774878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.774954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.775303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.775488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.775725] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.775831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.775892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.776140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.776304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.776552] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.776685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.776753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.777319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.777319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.777319] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d74e9b25-7fdc-4267-b1cb-16009a0c7d86 is going to be updated. [ 748.812170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.812170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.812170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.812170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.812170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.812170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d74e9b25-7fdc-4267-b1cb-16009a0c7d86" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.222723] env[65788]: INFO networking_nsxv3.common.synchronization [req-713cedd3-d664-4ec7-a856-c1d7ddc3ec43 req-5058a0ea-37ac-4b16-80bf-81190b127e6d tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 749.223341] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 749.223651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.223857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.225554] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.226125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.226280] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.550822] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 749.551166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.552492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.552738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.552935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.553100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.553146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.553283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.553363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.553458] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.729151] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.056483] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.128475] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.128699] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.128774] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.129035] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.129707] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.129707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.129707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.129893] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.129929] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.130486] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.130602] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.130711] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.130813] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.131392] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.131392] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.131392] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.151296] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.151296] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 750.151296] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.151553] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-794" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.152329] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-ba5b2000-2718-476b-ba51-dcae7fd2589b taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.152329] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.152329] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.152329] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.152605] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5b2000-2718-476b-ba51-dcae7fd2589b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.232913] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.558853] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.657023] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.657023] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.657023] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.657261] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.657261] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.657481] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port ba5b2000-2718-476b-ba51-dcae7fd2589b not found, creating... [ 750.657747] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.657876] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.657917] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.658144] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.658266] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.658544] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.659549] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.659549] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.659549] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.659549] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.659549] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: ba5b2000-2718-476b-ba51-dcae7fd2589b is going to be created. [ 750.687893] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.688188] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.688309] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.689269] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.689269] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.689464] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.735151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.735305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.735376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.735595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.735843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.735843] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 750.778660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.779977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.780172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.780494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.780686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.800500] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 751.055643] env[65788]: INFO networking_nsxv3.common.synchronization [None req-260df71e-e9a5-4374-a6d3-b99fdf570f0a None None] Enqueued Resource ID: 8078b07f-0147-4177-8822-b52d5e1a03a3 with Priority: HIGHEST for action port [ 751.056230] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8078b07f-0147-4177-8822-b52d5e1a03a3 with Priority: HIGHEST for action port [ 751.056555] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8078b07f-0147-4177-8822-b52d5e1a03a3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.056726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8078b07f-0147-4177-8822-b52d5e1a03a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.056820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8078b07f-0147-4177-8822-b52d5e1a03a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.058420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8078b07f-0147-4177-8822-b52d5e1a03a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.058420] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8078b07f-0147-4177-8822-b52d5e1a03a3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.065958] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.066457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.066457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.066457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.066581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.066609] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 751.106034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.106034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.106034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.106219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.106353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.120578] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 751.455708] env[65788]: INFO networking_nsxv3.common.synchronization [req-713cedd3-d664-4ec7-a856-c1d7ddc3ec43 req-b8283fb4-9e07-412c-a623-3bfc2da4b45d service nova] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 751.464587] env[65788]: INFO networking_nsxv3.common.synchronization [req-713cedd3-d664-4ec7-a856-c1d7ddc3ec43 req-b8283fb4-9e07-412c-a623-3bfc2da4b45d service nova] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 751.464587] env[65788]: INFO networking_nsxv3.common.synchronization [req-713cedd3-d664-4ec7-a856-c1d7ddc3ec43 req-b8283fb4-9e07-412c-a623-3bfc2da4b45d service nova] Enqueued Resource ID: ba5b2000-2718-476b-ba51-dcae7fd2589b with Priority: HIGHEST for action port [ 751.464587] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 751.464587] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 751.464587] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5b2000-2718-476b-ba51-dcae7fd2589b with Priority: HIGHEST for action port [ 751.464587] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.464587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.464587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.464587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.464587] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.465303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.465676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.469163] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba5b2000-2718-476b-ba51-dcae7fd2589b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.469455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.469491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.469775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.469898] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5b2000-2718-476b-ba51-dcae7fd2589b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.561820] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8078b07f-0147-4177-8822-b52d5e1a03a3 [ 751.561820] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.561820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.561820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.561820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.562146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.562146] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8078b07f-0147-4177-8822-b52d5e1a03a3 already deleted. [ 751.562146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8078b07f-0147-4177-8822-b52d5e1a03a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.834189] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-57fbc897-bee8-4203-a1b8-8414559b51a0 tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 751.834936] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 751.836303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.836303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.836303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.836303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.836303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.836303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.836303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.836303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.836598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.836598] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.973649] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.974414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.974414] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba5b2000-2718-476b-ba51-dcae7fd2589b with status ACTIVE [ 751.974414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.974414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.974414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.974756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.974756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.974811] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.975089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.975089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.975089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.975216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.975548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.975548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.975548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.975843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.975843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.975843] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba5b2000-2718-476b-ba51-dcae7fd2589b is going to be updated. [ 752.000349] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.000424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.000479] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.000690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.000855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.001026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.299919] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.300010] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.300432] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.300432] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.300678] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.300836] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.300948] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.301175] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.301313] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.301538] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.301651] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.301758] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.301863] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.301969] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.302084] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.302214] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.322310] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.322535] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.322680] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.322853] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.323191] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-9798237e-6141-457d-acc3-b512182f94f9 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.323361] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.323476] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.323861] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.323994] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9798237e-6141-457d-acc3-b512182f94f9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.337508] env[65788]: INFO networking_nsxv3.common.synchronization [req-52c2806b-2b98-459c-a03e-3a7802739831 req-0b123e3a-afaa-4f78-a57f-f90b6ce39eff tempest-VolumesAdminNegativeTest-618844079 tempest-VolumesAdminNegativeTest-618844079-project-member] Enqueued Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_members [ 752.338117] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGHEST for action security_group_members [ 752.338927] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.338927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.338927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.338927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.339204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.339204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.339316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.339371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.339757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.339757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.339757] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 already deleted. [ 752.339914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.340033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.340593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.340593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.340593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.340593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.340593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.340918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.340918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.340918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.340918] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.812074] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 752.812074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.812534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.812534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.812672] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.812795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.812860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.813053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.813146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.813237] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.826860] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.827084] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.827202] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.827482] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.827621] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.827770] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 9798237e-6141-457d-acc3-b512182f94f9 not found, creating... [ 752.828045] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.828204] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.828314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.828581] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.828693] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.828930] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.829092] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.829356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.829426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.829556] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.829690] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 9798237e-6141-457d-acc3-b512182f94f9 is going to be created. [ 752.843674] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.844224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.844224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.844412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.844600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.844994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.845183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.845270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.845461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.845576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.845702] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42357d17-1e70-4140-8be5-5413affdb68e is going to be updated. [ 752.851074] env[65788]: INFO networking_nsxv3.common.synchronization [req-847e9e38-bb18-4a3b-91ce-e477f038ff47 req-c3212b3e-7466-4abf-b24d-213b95c95f10 tempest-FloatingIPsAssociationTestJSON-899504544 tempest-FloatingIPsAssociationTestJSON-899504544-project-member] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 752.852551] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.852742] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.852866] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.853200] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.853429] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.853650] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.854909] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 752.855528] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.855625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.855689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.855912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.857811] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.857811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.857811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.858224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.858317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.859078] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.894079] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.894677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.895120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.895398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.895901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.910186] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42357d17-1e70-4140-8be5-5413affdb68e in Status: IN_PROGRESS for 2s [ 753.131453] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 753.131708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.132039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.132284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.132531] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.132626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.132732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.132929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.133047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.133174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.133293] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.316275] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.361811] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.591041] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-e57ac448-6e00-44bb-a61d-a85ec763fd7f service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 753.591041] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-e57ac448-6e00-44bb-a61d-a85ec763fd7f service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 753.591041] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-e57ac448-6e00-44bb-a61d-a85ec763fd7f service nova] Enqueued Resource ID: 9798237e-6141-457d-acc3-b512182f94f9 with Priority: HIGHEST for action port [ 753.591041] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 753.591041] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 753.591041] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9798237e-6141-457d-acc3-b512182f94f9 with Priority: HIGHEST for action port [ 753.591041] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.591757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.595044] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.595044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.595044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.595044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.595044] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.598576] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9798237e-6141-457d-acc3-b512182f94f9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.598827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.600077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.600077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.600077] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9798237e-6141-457d-acc3-b512182f94f9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.635375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.635828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.636046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.639178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.639178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.639178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.639178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.639817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.639817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.639817] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.819441] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.864420] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.105403] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9798237e-6141-457d-acc3-b512182f94f9 with status ACTIVE [ 754.105653] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.105790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.105857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.106085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.106173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.106350] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.106451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.106513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.106659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.106735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.108493] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.108626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.108709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.108868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.108946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.109344] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9798237e-6141-457d-acc3-b512182f94f9 is going to be updated. [ 754.111535] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.111718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.111920] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.141870] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1: rpc.has_security_group_logging(os_id): False [ 754.153544] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.153745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.153811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.154810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.154810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.154810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9798237e-6141-457d-acc3-b512182f94f9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.170024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.170024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.170024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.170293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.170293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.170911] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.170911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.170911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.170911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.170911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.171538] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.171538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.171538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.171538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.171538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.171773] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.171773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.171846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.171972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.172888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.173064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 754.256556] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.256705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.256779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.257028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.257147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.290200] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 754.322916] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.323185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.323185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.323402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.323506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.323614] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 754.367494] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.367608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.367687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.367906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.367998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.368116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 is going to be updated. [ 754.374211] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-6ea1fcb6-174d-4c26-a36d-37185affe556 tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 754.375198] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 754.375855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.375962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.400651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.400819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.401056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.401463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.401680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.426491] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 754.426491] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.426491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.426491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.426772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.426850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.441177] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: IN_PROGRESS for 2s [ 754.614925] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.823026] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.823026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.823026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.823026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.823026] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.823026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.823026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.823026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.823026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.825639] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.825639] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.825757] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.825897] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.826043] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.826154] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.826322] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.847732] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.847936] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.848106] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.848366] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.848753] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-1169a066-02eb-41bc-892c-5fce939595d0 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.848984] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.849053] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.849402] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.849570] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1169a066-02eb-41bc-892c-5fce939595d0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.920607] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42357d17-1e70-4140-8be5-5413affdb68e in Status: SUCCESS [ 754.920804] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42357d17-1e70-4140-8be5-5413affdb68e deletion is rescheduled due to dependency. [ 754.921052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.117311] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.117681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.117762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.117963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.118071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.118175] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be created. [ 755.142619] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.142795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.142795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.143012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.143184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.154612] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: UNINITIALIZED for 2s [ 755.352541] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.352772] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.352893] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.353191] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.353337] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.353488] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 1169a066-02eb-41bc-892c-5fce939595d0 not found, creating... [ 755.353756] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.353921] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.354046] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.354259] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.354403] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.354686] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.354835] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.354946] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.355170] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.355299] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.355435] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 1169a066-02eb-41bc-892c-5fce939595d0 is going to be created. [ 755.377098] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.377336] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.377455] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.377721] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.377939] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.378171] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.178120] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-f2cbcc9a-c1e4-4aa5-b183-fe55af03ab12 service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 756.178375] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-f2cbcc9a-c1e4-4aa5-b183-fe55af03ab12 service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 756.178472] env[65788]: INFO networking_nsxv3.common.synchronization [req-bec2957d-e301-49e3-850f-29ccce46b9b1 req-f2cbcc9a-c1e4-4aa5-b183-fe55af03ab12 service nova] Enqueued Resource ID: 1169a066-02eb-41bc-892c-5fce939595d0 with Priority: HIGHEST for action port [ 756.179189] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 756.179387] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 756.179522] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1169a066-02eb-41bc-892c-5fce939595d0 with Priority: HIGHEST for action port [ 756.179837] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.179957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.180193] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.180284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.180468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1169a066-02eb-41bc-892c-5fce939595d0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.180590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.180676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.181031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.181131] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1169a066-02eb-41bc-892c-5fce939595d0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.323697] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 756.323697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.438735] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.438735] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.438735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.438735] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.456575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: SUCCESS [ 756.456575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.685432] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1169a066-02eb-41bc-892c-5fce939595d0 with status ACTIVE [ 756.685673] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.685837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.685908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.686208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.686298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.686491] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.686608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.686651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.686828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.688049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.688049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.688049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.688049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.688049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.688049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.688049] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1169a066-02eb-41bc-892c-5fce939595d0 is going to be updated. [ 756.715047] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.715247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.715342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.715555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.715699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.716233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1169a066-02eb-41bc-892c-5fce939595d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.944188] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.944432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.944588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.947518] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.947518] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.947518] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.947518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.947518] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.166495] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 757.166495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.166495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.166495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.166495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.166696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.166696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.166833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.166880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.166985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.167195] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.170718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.172112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.172112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.172112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.172112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.172112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.172112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.172112] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.173436] env[65788]: INFO networking_nsxv3.common.synchronization [req-8efb7525-3939-4e13-9206-e866866ff0b1 req-a9d5e1fc-360d-480d-a99f-06ccac261423 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 757.174743] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 757.174743] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.174743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.174943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.175054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.175168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.175521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.175521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.175674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.175674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.175862] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.449909] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7: rpc.has_security_group_logging(os_id): False [ 757.473883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.474076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.474150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.474366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.474465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.474903] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.474903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.474903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.475118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.475118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.475246] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.475549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.475549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.475549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.475642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.476100] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.476100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.476100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.476100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.476339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.476339] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 757.542019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.542173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.542365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.542687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.542982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.572641] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.572641] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.572641] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.572641] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.576043] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.576043] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.576043] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.576406] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.576716] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.577184] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.577939] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.577939] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.577939] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.578121] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.578324] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.578677] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.593176] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 757.628027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.628027] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.628027] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.628027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.628454] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-093a6d9b-9470-44b5-93f2-23d96a80debd taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.628904] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.629232] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.629687] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.630076] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('093a6d9b-9470-44b5-93f2-23d96a80debd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.675098] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.676167] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.676286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.678834] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.678986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.679485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.679533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.680023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.680023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.680023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.680023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.680252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.680252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.681094] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c already deleted. [ 757.681094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.133645] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.133967] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.134048] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.134316] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.134465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.134617] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 093a6d9b-9470-44b5-93f2-23d96a80debd not found, creating... [ 758.134951] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.135213] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.135384] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.135595] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.135780] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.137722] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.137953] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.138099] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.138348] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.138495] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.138656] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 093a6d9b-9470-44b5-93f2-23d96a80debd is going to be created. [ 758.162552] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.162830] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.162994] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.163280] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.163598] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.163743] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.177519] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.681820] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.682661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.682661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.682661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.682661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.683610] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 758.717367] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.717514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.717570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.720067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.720067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.729514] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 758.949652] env[65788]: INFO networking_nsxv3.common.synchronization [req-8efb7525-3939-4e13-9206-e866866ff0b1 req-497657ef-3b72-4d21-b8ba-3ff8b44a188e service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 758.949819] env[65788]: INFO networking_nsxv3.common.synchronization [req-8efb7525-3939-4e13-9206-e866866ff0b1 req-497657ef-3b72-4d21-b8ba-3ff8b44a188e service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 758.949952] env[65788]: INFO networking_nsxv3.common.synchronization [req-8efb7525-3939-4e13-9206-e866866ff0b1 req-497657ef-3b72-4d21-b8ba-3ff8b44a188e service nova] Enqueued Resource ID: 093a6d9b-9470-44b5-93f2-23d96a80debd with Priority: HIGHEST for action port [ 758.951616] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 758.951784] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 758.951874] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093a6d9b-9470-44b5-93f2-23d96a80debd with Priority: HIGHEST for action port [ 758.952182] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.952359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.952437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.952787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.952787] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.953743] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.953864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.953933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.954410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.954721] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.954809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.954867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.955097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.955186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.955298] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.956640] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-093a6d9b-9470-44b5-93f2-23d96a80debd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.956640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.956775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.956897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.956982] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('093a6d9b-9470-44b5-93f2-23d96a80debd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.978985] env[65788]: INFO networking_nsxv3.common.synchronization [req-576c9fec-c4d8-4fb8-863a-99100641c450 req-ca2872ba-f687-411b-9b64-31e79acb15ec tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 758.979962] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 758.980951] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.980951] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.980951] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.981206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.981445] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.981552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.981671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.981895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.983349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.983535] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.275866] env[65788]: INFO networking_nsxv3.common.synchronization [req-ad58f112-abd5-4464-8696-bb5630c41515 req-22d043e6-d088-478b-94fa-5e95498d0253 tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 759.276447] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 759.276761] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.276909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.276953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.277497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.277709] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.277841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.277931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.278132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.278253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.278378] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.463051] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 093a6d9b-9470-44b5-93f2-23d96a80debd with status ACTIVE [ 759.463303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.463443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.463516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.463766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.463856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.464075] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.464835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.464835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.464835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.464835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.464835] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.464835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.464835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.465129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.465129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.465187] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 093a6d9b-9470-44b5-93f2-23d96a80debd is going to be updated. [ 759.466756] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.466872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.467043] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.487824] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.488008] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.488143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.488541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.488669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.488888] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.489150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.489150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.489245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.489328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.489429] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 759.500541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.500541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.500541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.500819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.501077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.501728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-093a6d9b-9470-44b5-93f2-23d96a80debd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.523012] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.523012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.523012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.523012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.524392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.533092] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 759.636699] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 759.636845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.783833] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.875939] env[65788]: INFO networking_nsxv3.common.synchronization [req-119bdbc4-d51d-4e49-a487-fada5e208b9b req-a493ce6f-9235-4e43-8c5a-c14e25a9f7a7 tempest-MigrationsAdminTest-390226756 tempest-MigrationsAdminTest-390226756-project-member] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 759.877594] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 759.878251] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.878437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.878514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.878744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.879233] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.879233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.879233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.879447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.879447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.879516] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.969858] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.286260] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.291911] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.291911] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.291911] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.291911] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.291911] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.292208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.292208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.293356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.293356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.293356] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.293356] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.293356] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.293356] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.293356] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.293356] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.293356] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.323722] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.323722] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.324195] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.324392] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.324719] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-dbc789af-a3f0-4a29-b618-493b3d5a56df taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.328019] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.328019] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.328019] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.328019] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc789af-a3f0-4a29-b618-493b3d5a56df',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.382777] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.474229] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.474390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.474480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.474968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.474968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.474968] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be created. [ 760.513407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.513589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.513661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.513887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.514071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.535968] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: UNINITIALIZED for 2s [ 760.741667] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 760.741839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.742203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.742577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.743749] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.743948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.743948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.744964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.744964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.744964] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.790091] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.790474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.790474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.790697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.790775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.790898] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 760.820589] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.820738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.820808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.821254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.821493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.827673] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.827840] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.827923] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.828240] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.829014] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.829014] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port dbc789af-a3f0-4a29-b618-493b3d5a56df not found, creating... [ 760.829014] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.829271] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.829271] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.829558] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.829689] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.829996] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.830170] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.830314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.830527] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.830596] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.830724] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: dbc789af-a3f0-4a29-b618-493b3d5a56df is going to be created. [ 760.832427] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 760.852052] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.852278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.852425] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.852673] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.853196] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.853196] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.886024] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.250619] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.389741] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.389741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.389741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.389741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.389741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.389741] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be updated. [ 761.422478] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.422622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.422712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.422922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.423247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.431591] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: IN_PROGRESS for 2s [ 761.552039] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 761.552039] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 deletion is rescheduled due to dependency. [ 761.552039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.591169] env[65788]: INFO networking_nsxv3.common.synchronization [req-119bdbc4-d51d-4e49-a487-fada5e208b9b req-c506c935-dd33-4b4a-a611-a389ca45541d service nova] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_rules [ 761.591467] env[65788]: INFO networking_nsxv3.common.synchronization [req-119bdbc4-d51d-4e49-a487-fada5e208b9b req-c506c935-dd33-4b4a-a611-a389ca45541d service nova] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 761.591777] env[65788]: INFO networking_nsxv3.common.synchronization [req-119bdbc4-d51d-4e49-a487-fada5e208b9b req-c506c935-dd33-4b4a-a611-a389ca45541d service nova] Enqueued Resource ID: dbc789af-a3f0-4a29-b618-493b3d5a56df with Priority: HIGHEST for action port [ 761.592405] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_rules [ 761.592657] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 761.592849] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbc789af-a3f0-4a29-b618-493b3d5a56df with Priority: HIGHEST for action port [ 761.593239] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.593371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.593463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.593750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.593875] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.594959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.595189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.595506] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbc789af-a3f0-4a29-b618-493b3d5a56df taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.595690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.595787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.596053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.596197] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc789af-a3f0-4a29-b618-493b3d5a56df',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.614682] env[65788]: INFO networking_nsxv3.common.synchronization [req-6074c726-48f4-4b6a-9f10-bbb662aacb96 req-54d134ba-8eb5-4415-8412-c8eb99613dd8 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 761.614682] env[65788]: INFO networking_nsxv3.common.synchronization [req-6074c726-48f4-4b6a-9f10-bbb662aacb96 req-54d134ba-8eb5-4415-8412-c8eb99613dd8 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 761.616942] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 761.616942] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 761.616942] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.617122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.617154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.617360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.617604] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.618022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.618022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.618022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.618138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.618695] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.619368] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.620034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.620145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.620572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.620728] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.620787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.621689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.621689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.621689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.621689] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.665817] env[65788]: INFO networking_nsxv3.common.synchronization [req-6074c726-48f4-4b6a-9f10-bbb662aacb96 req-54d134ba-8eb5-4415-8412-c8eb99613dd8 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 761.666197] env[65788]: INFO networking_nsxv3.common.synchronization [req-6074c726-48f4-4b6a-9f10-bbb662aacb96 req-54d134ba-8eb5-4415-8412-c8eb99613dd8 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 761.668266] env[65788]: INFO networking_nsxv3.common.synchronization [req-6074c726-48f4-4b6a-9f10-bbb662aacb96 req-54d134ba-8eb5-4415-8412-c8eb99613dd8 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_rules [ 761.668700] env[65788]: INFO networking_nsxv3.common.synchronization [req-6074c726-48f4-4b6a-9f10-bbb662aacb96 req-54d134ba-8eb5-4415-8412-c8eb99613dd8 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 761.669062] env[65788]: INFO networking_nsxv3.common.synchronization [req-6074c726-48f4-4b6a-9f10-bbb662aacb96 req-54d134ba-8eb5-4415-8412-c8eb99613dd8 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: ba5b2000-2718-476b-ba51-dcae7fd2589b with Priority: HIGHEST for action port [ 761.669821] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 761.670098] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_rules [ 761.670401] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5b2000-2718-476b-ba51-dcae7fd2589b with Priority: HIGHEST for action port [ 761.674059] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 761.674059] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 761.674059] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.674059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.674059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.674059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.674059] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.674960] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.675784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.676081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.678580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.678580] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.680648] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba5b2000-2718-476b-ba51-dcae7fd2589b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.680648] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.680648] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.680648] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.680648] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5b2000-2718-476b-ba51-dcae7fd2589b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.682451] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.682691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.683097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.683304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.753729] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.098905] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.098905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.099360] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbc789af-a3f0-4a29-b618-493b3d5a56df with status ACTIVE [ 762.099360] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.099360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.099658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.099658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.099767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.099941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.100050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.100147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.100344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.100469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.100742] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.100868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.100965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.101202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.101323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.101463] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbc789af-a3f0-4a29-b618-493b3d5a56df is going to be updated. [ 762.125466] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.125466] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.125466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.125466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.125797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.125840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.126000] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbc789af-a3f0-4a29-b618-493b3d5a56df" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.126341] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.184593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.184802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.185555] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.185555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.185774] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba5b2000-2718-476b-ba51-dcae7fd2589b with status ACTIVE [ 762.186125] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.186125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.186125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.186746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.186746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.186820] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.186984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.188403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.188403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.188403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.188403] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.188403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.188403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.188712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.189436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.189436] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba5b2000-2718-476b-ba51-dcae7fd2589b is going to be updated. [ 762.225721] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.225721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.225721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.226097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.226097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.226327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.258663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.259271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.259271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.259271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.259588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.259588] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 762.307249] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.308504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.308504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.308758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.308941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.323251] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 762.347220] env[65788]: INFO networking_nsxv3.common.synchronization [req-9bd1157a-996d-4267-95cd-1e791918ea36 req-209e8e74-54dc-4282-8257-02248376c865 tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 762.347594] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 762.347908] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.348156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.348240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.348472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.349181] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.349181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.349181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.349181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.349181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.349181] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.550632] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 762.551030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.551208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.551591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.551962] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.552265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.552461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.552684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.552807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.552885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.553018] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.608086] env[65788]: INFO networking_nsxv3.common.synchronization [req-00db24b8-4e3b-4b9f-b766-12410d85ad04 req-d9d65fae-1a46-400f-b923-0a70c6079f2d tempest-ServersNegativeTestJSON-1756087549 tempest-ServersNegativeTestJSON-1756087549-project-member] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 762.608478] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 762.609434] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.609584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.609653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.609915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.610101] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.610221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.610290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.610447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.610535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.610636] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.628573] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.629476] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.846147] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 762.846558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.852720] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.037796] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.037796] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.038013] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.038294] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.039072] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.039072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.039072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.039072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.039318] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.039481] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.039555] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.039662] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.039885] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.039885] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.040028] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.040138] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.055469] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.055687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.055768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.055962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.056154] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.056247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.056310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.056453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.056542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.056660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.056820] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.056917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.056974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.057128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.057267] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.057358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.057432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.057550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.057713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.057713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.057821] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.062780] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.062960] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.063253] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.063253] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.063539] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-cdb92fba-2145-4abf-bb64-5ba310a8aa24 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.063689] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.063871] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.064135] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.064273] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb92fba-2145-4abf-bb64-5ba310a8aa24',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.114244] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.114620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.114620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.114719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.114936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.115044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.115126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.115164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.115289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.115361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.115444] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 already deleted. [ 763.115522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.132534] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.132738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.132738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.132948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.133045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.133153] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be created. [ 763.134443] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.134543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.134604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.134776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.134854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.134940] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 763.166160] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.166340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.166413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.166906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.167304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.169151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.169265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.169335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.169512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.169770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.182070] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 763.182766] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: UNINITIALIZED for 2s [ 763.355755] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.446080] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 763.446454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.447045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.447534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.447534] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.447773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.447773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.449348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.449348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.449348] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.563683] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605d7441-fa35-48f3-be10-861643ff1c6c: rpc.has_security_group_logging(os_id): False [ 763.567146] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.567386] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.567386] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.567704] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.567902] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.568759] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port cdb92fba-2145-4abf-bb64-5ba310a8aa24 not found, creating... [ 763.569234] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.569544] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.569672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.569965] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.570175] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.570649] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.570873] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.571603] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.571929] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.572142] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.572415] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 is going to be created. [ 763.591714] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.591933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.592127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.592410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.592543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.592890] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.593149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.593149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.593399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.593586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.593788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.593929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.594232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.594483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.594702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.594984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.595203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.595203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.595419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.595560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.595674] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be created. [ 763.599664] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.599911] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.600084] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.600437] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.600755] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.601197] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.702195] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.702503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.702620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.703072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.703328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.729018] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 763.858934] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.859118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.859196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.859465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.859579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.859723] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 763.897390] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.897764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.897764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.898602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.898602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.913303] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 763.950943] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.081728] env[65788]: INFO networking_nsxv3.common.synchronization [req-c352bf87-bbec-48c1-af83-db21aaf81d82 req-2e286de4-1666-4eef-9924-f5098a61bf1b tempest-ServersTestBootFromVolume-728581813 tempest-ServersTestBootFromVolume-728581813-project-member] Enqueued Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_members [ 764.082244] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1723657c-045d-4e76-905a-f1602b6cbec4 with Priority: HIGHEST for action security_group_members [ 764.082688] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1723657c-045d-4e76-905a-f1602b6cbec4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.082862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.082962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.083263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.083480] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.083624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.083826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.083948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.084099] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.084244] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1723657c-045d-4e76-905a-f1602b6cbec4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.334494] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 764.334876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.334876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.335312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.335397] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.335452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.335519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.335704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.335755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.335795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.335954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.336335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.336335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.336335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.336540] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.336540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.336540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.336717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.336717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.336823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.336875] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.344309] env[65788]: INFO networking_nsxv3.common.synchronization [req-00db24b8-4e3b-4b9f-b766-12410d85ad04 req-e32a1c85-e313-4abc-a937-674c7f4a385b service nova] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_rules [ 764.344477] env[65788]: INFO networking_nsxv3.common.synchronization [req-00db24b8-4e3b-4b9f-b766-12410d85ad04 req-e32a1c85-e313-4abc-a937-674c7f4a385b service nova] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 764.344613] env[65788]: INFO networking_nsxv3.common.synchronization [req-00db24b8-4e3b-4b9f-b766-12410d85ad04 req-e32a1c85-e313-4abc-a937-674c7f4a385b service nova] Enqueued Resource ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 with Priority: HIGHEST for action port [ 764.345160] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_rules [ 764.345269] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 764.345369] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 with Priority: HIGHEST for action port [ 764.346425] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.346555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.346628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.346936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.347044] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.349265] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.349537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.349718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.349907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.350062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.350134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.350217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.350382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.350468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.350564] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.351681] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdb92fba-2145-4abf-bb64-5ba310a8aa24 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.351852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.351926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.352108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.352186] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb92fba-2145-4abf-bb64-5ba310a8aa24',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.454583] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.586867] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.587397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.587506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.587915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.588064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.588349] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.588467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.588558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.588777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.588911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.589114] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1723657c-045d-4e76-905a-f1602b6cbec4 is going to be updated. [ 764.645601] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.645847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.645847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.646100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.646245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.679060] env[65788]: INFO networking_nsxv3.common.synchronization [req-ddab6af2-8718-4d67-98c2-9e1d1af585a0 req-5a7afe29-3ed9-47b0-85e0-84e4f835f551 tempest-ServersAdminNegativeTestJSON-2035322777 tempest-ServersAdminNegativeTestJSON-2035322777-project-member] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 764.679060] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 764.679060] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.679060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.679060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.679946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.680306] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.680584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.680775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.681337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.681672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.681883] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.685111] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1723657c-045d-4e76-905a-f1602b6cbec4 in Status: IN_PROGRESS for 2s [ 764.839335] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44: rpc.has_security_group_logging(os_id): False [ 764.853604] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.855169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.855281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.856257] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdb92fba-2145-4abf-bb64-5ba310a8aa24 with status ACTIVE [ 764.856257] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.856257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.856257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.856257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.856257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.856719] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.856719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.856719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.856719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.856719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.856946] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.856946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.857027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.857628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.857628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.857628] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 is going to be updated. [ 764.860111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.860289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.860413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.860734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.860867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.864228] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.864385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.864448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.864606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.864743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.864892] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.864990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.865056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.865198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.865610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.865610] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.865610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.865610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.866021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.866021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.866021] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be created. [ 764.894923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.895171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.895425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.895693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.895857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.896487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.938677] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.938827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.938895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.939195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.939411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.957620] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 764.959456] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.959710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.959823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.960102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.960268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.960388] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be updated. [ 765.037199] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.037364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.037433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.037706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.037900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.063109] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: IN_PROGRESS for 2s [ 765.187967] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.193737] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: SUCCESS [ 765.193737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.194683] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 765.194683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.194683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.194683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.195187] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.195187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.195187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.195187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.195598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.195598] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.196424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.196424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.196590] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.196676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.196676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.196920] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.196920] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.197050] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.369771] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.693410] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.700273] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.700913] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.745392] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 765.745392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.874249] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.874404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.874525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.874691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.874776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.874885] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be created. [ 765.905447] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.905753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.905832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.906124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.906320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.921894] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: UNINITIALIZED for 2s [ 765.928194] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 765.928194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.197521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.197521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.197521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.197834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.197834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.197834] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b is going to be updated. [ 766.204101] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.205934] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.236255] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.238125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.238332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.238675] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.238872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.255163] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: IN_PROGRESS for 2s [ 766.696588] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1723657c-045d-4e76-905a-f1602b6cbec4 in Status: SUCCESS [ 766.696588] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1723657c-045d-4e76-905a-f1602b6cbec4 deletion is rescheduled due to dependency. [ 766.696588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1723657c-045d-4e76-905a-f1602b6cbec4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.707461] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.707616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.707682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.707897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.707981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.708089] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be updated. [ 766.709399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.709504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.709589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.709786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.709876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.709962] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 766.771935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.772181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.772181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.772414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.772867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.775084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.775308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.775379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.775569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.775706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.788894] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: IN_PROGRESS for 2s [ 766.789830] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 766.971774] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 766.972010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.972203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.972418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.972530] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.073432] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 767.073658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.073832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.074069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.074261] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.074374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.074470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.074633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.074729] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.074806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.074892] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.475805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.476010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.477211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.477211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.477211] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.477211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.477211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.477211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.477545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.477545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.477545] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.577522] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.577688] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.577726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.578381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.578381] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.578381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.578381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.578679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.578679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.578679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.578763] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.579400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.579400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.579834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.580052] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.580170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.580239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.580403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.580491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.580587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.580683] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.936279] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 767.936697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.939035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.939035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.939035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.939035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.939035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.939035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.939035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.939035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.939035] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.983112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.983330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.983640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.983756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.984088] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.984088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.984270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.984363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.984428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.984467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.984628] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.984964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.984964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.984964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.985083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.985205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.985205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.985341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.985419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.985500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.985596] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.082720] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b88372-ae25-44bd-b47b-e818f59c5f00: rpc.has_security_group_logging(os_id): False [ 768.103691] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.103691] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.103691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.103691] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.104190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.104190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.104190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.104190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.104290] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.104356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.104413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.104549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.104654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.104720] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be updated. [ 768.184379] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.184518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.184585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.184806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.184948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.203134] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: IN_PROGRESS for 2s [ 768.274021] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: SUCCESS [ 768.274021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.442228] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.443444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.443444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.445890] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.445890] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.445890] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.445890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.445890] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.488515] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44: rpc.has_security_group_logging(os_id): False [ 768.513896] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.514125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.514219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.514446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.514548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.514779] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.514892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.514989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.515231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.515337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.515631] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.515751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.515813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.515995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.516090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.516354] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.516508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.516599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.516824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.516951] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.517116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 768.607498] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.609977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.609977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.609977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.609977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.626468] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 768.801420] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: SUCCESS [ 768.801717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.801914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.802194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.802398] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.802574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.802652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.802844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.802956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.803081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.803166] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.806737] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.806737] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.806737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.806737] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.869519] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 768.869519] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 768.869519] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_members [ 768.869519] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 768.869519] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 768.869519] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_members [ 768.870734] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.870734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.870734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.870734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.871223] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.871314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.871388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.871898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.872058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.872205] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.874712] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.874712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.874712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.874712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.875047] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.875202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.875246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.875438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.875535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.875658] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.877579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7adccd5b-4387-42b0-a921-f4101f87b1ad taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.877723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.877796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.878391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.878391] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.878391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.878560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.878599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.878693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.878971] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.950623] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c1f029-c9a0-40e2-afd5-a6e6e896f095: rpc.has_security_group_logging(os_id): False [ 768.963243] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 768.965651] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 768.965651] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_rules [ 768.965651] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 768.965651] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_rules [ 768.965651] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_members [ 768.967084] env[65788]: INFO networking_nsxv3.common.synchronization [req-6429d516-ce3c-4be4-b383-e0e4840ce52e req-db5b6324-6e75-4176-8ed5-49f83260ee09 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: ba5b2000-2718-476b-ba51-dcae7fd2589b with Priority: HIGHEST for action port [ 768.967940] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_rules [ 768.968113] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_rules [ 768.968311] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_members [ 768.968367] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5b2000-2718-476b-ba51-dcae7fd2589b with Priority: HIGHEST for action port [ 768.968410] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_rules [ 768.968639] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 768.968701] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 768.969079] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.969217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.969436] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.969631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.969876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7adccd5b-4387-42b0-a921-f4101f87b1ad taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.969975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.970255] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba5b2000-2718-476b-ba51-dcae7fd2589b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.970372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.970498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.970679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.970776] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5b2000-2718-476b-ba51-dcae7fd2589b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.971895] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7adccd5b-4387-42b0-a921-f4101f87b1ad taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.971966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.972060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.972320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.972426] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.976169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.976169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.976169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.976169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.977213] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.977345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.977426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.977649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.977753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.977935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.980145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.980145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.980145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.980145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.980145] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.980667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.981619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.981619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.981619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.981841] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.982370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.982370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.982370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.982497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.983372] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be created. [ 769.052805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.052805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.052805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.052805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.052805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.066754] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 769.291654] env[65788]: INFO networking_nsxv3.common.synchronization [req-d8454519-edbf-4986-a8d1-8d0e77e4ef4b req-e8ee4241-16d0-4c85-a922-7c7013a51db4 tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 769.291654] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 769.291654] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.291654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.291654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.292327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.292327] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.292327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.292327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.292327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.292576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.292576] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.309210] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.310220] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.310438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.375125] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.377959] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.381991] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.475883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7adccd5b-4387-42b0-a921-f4101f87b1ad taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.476032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.477452] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba5b2000-2718-476b-ba51-dcae7fd2589b with status ACTIVE [ 769.477641] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.477773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.477847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.478353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.478458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.478653] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.478760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.478822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.479010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.480130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.480130] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.480130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.480130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.480130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.480130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.480130] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba5b2000-2718-476b-ba51-dcae7fd2589b is going to be updated. [ 769.502310] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.502477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.502568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.502784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.502924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.503218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba5b2000-2718-476b-ba51-dcae7fd2589b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.610383] env[65788]: INFO networking_nsxv3.common.synchronization [req-2a04a529-06e4-4626-b9fd-b489c5790fd1 req-06bafeba-1e72-45c8-afa1-8ed2d47f3780 tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 769.610383] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 769.610536] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.610590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.795814] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.812119] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41bb08da-7387-43a0-b7d4-fffc0c3a3846: rpc.has_security_group_logging(os_id): False [ 769.832692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.832873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.832873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.833086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.833345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.833681] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.833681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.833681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.834416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.834416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.834416] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be created. [ 769.878908] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.880806] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.885272] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.890052] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.890052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.890052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.890052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.890052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.903918] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: IN_PROGRESS for 2s [ 770.216423] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 770.216846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.300360] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.380555] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.380717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.380791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.381060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.381139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.381281] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 770.382692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.382800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.382869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.383054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.383141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.383227] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be updated. [ 770.389663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.389663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.389663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.389663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.389663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.389663] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad is going to be created. [ 770.420533] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.420672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.420753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.421595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.421764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.424047] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.424047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.424047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.424904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.424904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.426507] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.426620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.426708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.427266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.427266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.436820] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: IN_PROGRESS for 2s [ 770.437581] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 770.438397] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad in Status: UNINITIALIZED for 2s [ 770.646213] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 770.646524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.806636] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.808992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.808992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.808992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.808992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.808992] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 770.840763] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.840763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.840763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.840763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.840763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.850260] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 771.079598] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 771.079808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.419283] env[65788]: INFO networking_nsxv3.common.synchronization [None req-32e79d55-1cff-4f6d-9944-718730397df9 tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_rules [ 771.419635] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_rules [ 771.419756] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.419891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.419989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.420730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.420840] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.555788] env[65788]: INFO networking_nsxv3.common.synchronization [None req-53fd34fe-5e67-47dd-8e80-fe6fabee48fa tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_rules [ 771.556477] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_rules [ 771.557963] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.558384] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.917333] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: SUCCESS [ 771.917556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.917719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.917983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.918087] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.942935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.943120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.943167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.943371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.943465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.943548] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 already deleted. [ 771.943645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.944074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.944074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.944074] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.421954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.422530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.449386] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 772.449626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.449813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.450062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.450254] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.450374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.450443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.450615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.450706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.450820] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.452780] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad in Status: SUCCESS [ 772.452932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.453621] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: SUCCESS [ 772.454063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.455059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.455525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.455918] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.456048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.456130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.456421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.456539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.456952] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.457856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.458959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.458959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.458959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.458959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.459192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.459192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.459349] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.462225] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.484292] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.484464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.484512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.484751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.484862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.484978] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 already deleted. [ 772.485080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.863628] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 772.863884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.863884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.864352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.864352] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.864471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.864506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.864676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.864990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.864990] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.962209] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.964462] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.965425] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.977171] env[65788]: INFO networking_nsxv3.common.synchronization [req-06746cf9-c96f-40a4-8942-8dcc0b0f204b req-0f3781e3-1285-4475-85dc-b109b6ebb11a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 772.977171] env[65788]: INFO networking_nsxv3.common.synchronization [req-06746cf9-c96f-40a4-8942-8dcc0b0f204b req-0f3781e3-1285-4475-85dc-b109b6ebb11a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 772.977316] env[65788]: INFO networking_nsxv3.common.synchronization [req-06746cf9-c96f-40a4-8942-8dcc0b0f204b req-0f3781e3-1285-4475-85dc-b109b6ebb11a tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_members [ 772.978130] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 772.978447] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGHEST for action security_group_members [ 772.978447] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad with Priority: HIGHEST for action security_group_members [ 772.978674] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.979464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.979754] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.979888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.980227] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7adccd5b-4387-42b0-a921-f4101f87b1ad taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.980227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.277406] env[65788]: INFO networking_nsxv3.common.synchronization [req-8324f0e9-84f3-4810-ac0a-779f06464d58 req-b197c003-66b6-4ea7-8726-c96675d76a18 tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 773.277910] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 773.278239] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.278368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.278495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.278653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.278814] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.278924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.278995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.279128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.279212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.279311] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.370779] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.370779] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.370779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.370779] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 773.409972] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.410246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.410246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.410412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.411016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.428442] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 773.465761] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.466638] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.471944] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.472106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.472174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.472388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.472470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.472582] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 773.511996] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.511996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.511996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.511996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.512203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.524727] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 773.782414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.782414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.782414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.782558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.782587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.782828] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.782902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.782936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.783172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.783243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.783417] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 773.811777] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.811919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.811987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.812216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.812349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.815478] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.815810] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.815810] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.816013] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.816370] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.816522] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.816633] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.816834] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.816960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.817177] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.817384] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.817507] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.817613] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.817718] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.817817] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.817943] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.823130] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 773.835212] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.835376] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.835510] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.835679] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.835990] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-a277d64e-f2da-47a2-bfca-4e0929bf2855 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.836247] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.836370] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.836678] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.836842] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a277d64e-f2da-47a2-bfca-4e0929bf2855',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.972455] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.972455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.972455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.972956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.972956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.972956] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be updated. [ 773.973924] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.974082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.974149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.974273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.974355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.974446] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad is going to be updated. [ 774.005282] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.005282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.005457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.005594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.005657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.007537] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.007802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.007949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.008318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.008572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.019702] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad in Status: IN_PROGRESS for 2s [ 774.020405] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: IN_PROGRESS for 2s [ 774.339548] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.339820] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.339931] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.340660] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.340939] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.341137] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port a277d64e-f2da-47a2-bfca-4e0929bf2855 not found, creating... [ 774.341401] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.341635] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.341764] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.342174] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.342174] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.342449] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.342759] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.342973] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.343262] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.343438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.343637] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: a277d64e-f2da-47a2-bfca-4e0929bf2855 is going to be created. [ 774.370919] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.370919] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.370919] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.370919] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.370919] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.370919] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.162466] env[65788]: INFO networking_nsxv3.common.synchronization [req-8324f0e9-84f3-4810-ac0a-779f06464d58 req-9d538d93-2867-4ecd-8b97-97095f4aa5ee service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 775.162466] env[65788]: INFO networking_nsxv3.common.synchronization [req-8324f0e9-84f3-4810-ac0a-779f06464d58 req-9d538d93-2867-4ecd-8b97-97095f4aa5ee service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 775.162466] env[65788]: INFO networking_nsxv3.common.synchronization [req-8324f0e9-84f3-4810-ac0a-779f06464d58 req-9d538d93-2867-4ecd-8b97-97095f4aa5ee service nova] Enqueued Resource ID: a277d64e-f2da-47a2-bfca-4e0929bf2855 with Priority: HIGHEST for action port [ 775.163127] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 775.163320] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 775.163389] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a277d64e-f2da-47a2-bfca-4e0929bf2855 with Priority: HIGHEST for action port [ 775.163613] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.163741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.163808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.164069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.164138] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.164963] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.165069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.168017] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a277d64e-f2da-47a2-bfca-4e0929bf2855 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.168017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.168017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.168017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.168017] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a277d64e-f2da-47a2-bfca-4e0929bf2855',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.442710] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 775.442710] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 deletion is rescheduled due to dependency. [ 775.442710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.534368] env[65788]: INFO networking_nsxv3.common.synchronization [None req-70541547-1422-40c3-84da-09f861b0197e None None] Enqueued Resource ID: 1dc86fe4-79cb-4aaf-be2a-d988adb20b0e with Priority: HIGHEST for action port [ 775.535019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dc86fe4-79cb-4aaf-be2a-d988adb20b0e with Priority: HIGHEST for action port [ 775.535332] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dc86fe4-79cb-4aaf-be2a-d988adb20b0e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.535458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dc86fe4-79cb-4aaf-be2a-d988adb20b0e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.535526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dc86fe4-79cb-4aaf-be2a-d988adb20b0e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.535789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dc86fe4-79cb-4aaf-be2a-d988adb20b0e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.536215] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dc86fe4-79cb-4aaf-be2a-d988adb20b0e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.539637] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 775.541410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.541786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.541999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.542207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.542323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.542702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.544258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.544385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.544670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.544670] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.544793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.544844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.544983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.545151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.545251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.545312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.545449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.545520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.545604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.545692] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.546809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.546973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.547138] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.547234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.547297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.547431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.547510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.547600] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.667989] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.668187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.668462] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a277d64e-f2da-47a2-bfca-4e0929bf2855 with status ACTIVE [ 775.668711] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.668865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.668974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.669308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.669442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.669710] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.669873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.670279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.670279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.670389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.670621] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.670780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.670882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.671272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.671272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.671391] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a277d64e-f2da-47a2-bfca-4e0929bf2855 is going to be updated. [ 775.695057] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.695057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.695057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.695057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.695057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.695057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a277d64e-f2da-47a2-bfca-4e0929bf2855" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.841824] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 775.842135] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 775.842316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.842586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.842869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.843090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.843288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.843389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.843588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.843728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.843883] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.035337] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: SUCCESS [ 776.035601] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.036924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.036924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.036924] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.036924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.036924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.037392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.037392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.037596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.038353] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.042097] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad in Status: SUCCESS [ 776.042097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.042097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.042097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.042097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.042097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.042097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.042097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.042097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.042097] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.044923] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dc86fe4-79cb-4aaf-be2a-d988adb20b0e [ 776.044923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.044923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.044923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.044923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.044923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.044923] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dc86fe4-79cb-4aaf-be2a-d988adb20b0e already deleted. [ 776.044923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dc86fe4-79cb-4aaf-be2a-d988adb20b0e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.044923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.048295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.048295] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.048295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.048295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.048295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.048295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.048295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.048295] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.052134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.052134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.052134] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.052134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.052134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.052134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.052134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.052714] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.053787] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7: rpc.has_security_group_logging(os_id): False [ 776.056903] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.076128] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.076312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.076680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.076680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.076814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.076982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.077174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.077258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.077870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.077870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.077870] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.078131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.078191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.078404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.078404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.078604] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.078881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.078881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.079431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.079431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.079431] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 776.146166] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.146397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.146508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.147015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.147089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.167641] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 776.346271] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.552221] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.552221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.552221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.552221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.552221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.552221] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.552221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.552221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.552221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.552575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.552575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be updated. [ 776.553913] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.558065] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.558188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.558223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.558494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.558628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.558937] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.559115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.559725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.559725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.559725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.559725] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad is going to be deleted. [ 776.560740] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7adccd5b-4387-42b0-a921-f4101f87b1ad',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.563539] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.564893] env[65788]: INFO networking_nsxv3.common.synchronization [req-0c90c8f5-930b-4bdd-b409-5f70747a8ba8 req-e4173ffd-6aa2-4b2c-b130-402ea4db226e tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_members [ 776.565572] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_members [ 776.566239] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.566603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.566603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.566793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.566962] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.567091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.567160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.567580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.568080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.568080] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.603308] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.603456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.603520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.603734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.603883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.620030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.620175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.620243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.620488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.620582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.620678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.622868] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: IN_PROGRESS for 2s [ 776.851379] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.025252] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.025438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.025555] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.025996] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.026293] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.026470] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.026577] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.026929] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.027022] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.027209] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.027677] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.027866] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.027971] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.028085] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.028223] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.028372] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.052062] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.052355] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.052569] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.052842] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.053372] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-bc97b411-ac80-4e95-aaea-8bedd58e4d22 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.053699] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.053907] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.054501] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.054775] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc97b411-ac80-4e95-aaea-8bedd58e4d22',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.056869] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41bb08da-7387-43a0-b7d4-fffc0c3a3846: rpc.has_security_group_logging(os_id): False [ 777.068173] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.068173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.068173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.068173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.068173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.068173] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 777.070021] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7adccd5b-4387-42b0-a921-f4101f87b1ad: rpc.has_security_group_logging(os_id): False [ 777.070364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.070488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.070550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.070744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.070868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.071020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.071117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.071171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.071315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.071389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.071469] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 already deleted. [ 777.071590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.077529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.077664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.077735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.078336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.078336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.078336] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.078511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.078511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.078719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.078805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.078901] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be updated. [ 777.092111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.092458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.092458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.092683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.092783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.093093] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.093232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.093316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.093533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.093640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.094120] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad is going to be created. [ 777.111989] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.112152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.112264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.112582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.112778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.118562] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7adccd5b-4387-42b0-a921-f4101f87b1ad], does not exist path=[/infra/domains/default/groups/7adccd5b-4387-42b0-a921-f4101f87b1ad]."\n}' [ 777.118974] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7adccd5b-4387-42b0-a921-f4101f87b1ad [ 777.118974] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 777.122301] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 777.148194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.148194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.148194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.148194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.148194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.161361] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: IN_PROGRESS for 2s [ 777.168921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.169277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.169277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.169502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.170811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.171499] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.171499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.171499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.171499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.171725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.171804] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.171902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.171954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.172147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.172228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.172269] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7adccd5b-4387-42b0-a921-f4101f87b1ad is going to be created. [ 777.192456] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7adccd5b-4387-42b0-a921-f4101f87b1ad], does not exist path=[/infra/domains/default/groups/7adccd5b-4387-42b0-a921-f4101f87b1ad]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7adccd5b-4387-42b0-a921-f4101f87b1ad [ 777.192456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7adccd5b-4387-42b0-a921-f4101f87b1ad" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.193212] env[65788]: Traceback (most recent call last): [ 777.193288] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 777.193288] env[65788]: return func(*args, **kwargs) [ 777.193288] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.193288] env[65788]: res.raise_for_status() [ 777.193288] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.193288] env[65788]: raise HTTPError(http_error_msg, response=self) [ 777.193288] env[65788]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7adccd5b-4387-42b0-a921-f4101f87b1ad [ 777.193288] env[65788]: During handling of the above exception, another exception occurred: [ 777.193288] env[65788]: Traceback (most recent call last): [ 777.193288] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 777.193288] env[65788]: listener.cb(fileno) [ 777.193288] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 777.193288] env[65788]: result = function(*args, **kwargs) [ 777.193288] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 777.193288] env[65788]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 777.193844] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 777.193844] env[65788]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 777.193844] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 777.193844] env[65788]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 777.193844] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.193844] env[65788]: res.raise_for_status() [ 777.193844] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.193844] env[65788]: raise HTTPError(http_error_msg, response=self) [ 777.193844] env[65788]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7adccd5b-4387-42b0-a921-f4101f87b1ad [ 777.193844] env[65788]: Removing descriptor: 15 [ 777.359467] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.359467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.359467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.359467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.359467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.359467] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 777.408364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.408596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.408715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.408969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.409196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.420440] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 777.557439] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.557812] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.557812] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.558100] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.558252] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.558439] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port bc97b411-ac80-4e95-aaea-8bedd58e4d22 not found, creating... [ 777.558718] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.558879] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.558992] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.559231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.559361] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.559657] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.559822] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.559908] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.560198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.560344] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.560483] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: bc97b411-ac80-4e95-aaea-8bedd58e4d22 is going to be created. [ 777.590213] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.590213] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.590213] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.590213] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.590213] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.590213] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.009020] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent loop - iteration:0 completed [ 778.009020] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent loop - iteration:1 started [ 778.181456] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 778.181843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.181961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.182339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.182473] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.317909] env[65788]: INFO networking_nsxv3.common.synchronization [req-0c90c8f5-930b-4bdd-b409-5f70747a8ba8 req-62dc6fb1-4716-4a13-9428-6493ce52a2ce service nova] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_rules [ 778.318116] env[65788]: INFO networking_nsxv3.common.synchronization [req-0c90c8f5-930b-4bdd-b409-5f70747a8ba8 req-62dc6fb1-4716-4a13-9428-6493ce52a2ce service nova] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_members [ 778.318217] env[65788]: INFO networking_nsxv3.common.synchronization [req-0c90c8f5-930b-4bdd-b409-5f70747a8ba8 req-62dc6fb1-4716-4a13-9428-6493ce52a2ce service nova] Enqueued Resource ID: bc97b411-ac80-4e95-aaea-8bedd58e4d22 with Priority: HIGHEST for action port [ 778.318447] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_rules [ 778.318619] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_members [ 778.318726] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc97b411-ac80-4e95-aaea-8bedd58e4d22 with Priority: HIGHEST for action port [ 778.320062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.320209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.320410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.320808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.320875] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.322581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.322718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.322967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.323177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.323359] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.323719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.323795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.323977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.324058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.324162] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.324978] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc97b411-ac80-4e95-aaea-8bedd58e4d22 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.325180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.325293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.325377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.325459] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc97b411-ac80-4e95-aaea-8bedd58e4d22',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.636105] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: SUCCESS [ 778.636291] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 deletion is rescheduled due to dependency. [ 778.636924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.687635] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.687635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.830172] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc97b411-ac80-4e95-aaea-8bedd58e4d22 with status ACTIVE [ 778.831263] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.831263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.831263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.831263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.831263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.831622] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.831622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.831622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.831737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.831766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.831948] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.832073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.832134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.832313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.832374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.832433] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc97b411-ac80-4e95-aaea-8bedd58e4d22 is going to be updated. [ 778.833903] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.835054] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.835215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.857019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.857508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.857508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.857619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.857876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.857942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc97b411-ac80-4e95-aaea-8bedd58e4d22" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.134466] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 779.134669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.134847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.135191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.135255] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.135382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.135382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.136289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.136289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.136289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.136289] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.175813] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 in Status: SUCCESS [ 779.176426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.336921] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.351987] env[65788]: INFO networking_nsxv3.common.synchronization [req-7f99bbff-b2c9-4bbd-88ec-16c70dc21fac req-960a766e-28f5-4b26-8d06-b23a86f33a13 tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 779.352554] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 779.352872] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.353028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.353073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.353275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.353431] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.353531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.353593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.353741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.353848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.353920] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.431428] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 779.431428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.432391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.432391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.432391] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.432391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.432391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.434050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.434050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.434050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.434050] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.640546] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.640795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.640795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.641039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.641247] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.641380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.641462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.641854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.641978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.642121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.642304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.642378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.642434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.642596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.642734] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.642827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.642889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.643063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.643122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.643202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.643294] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.777018] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.777018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.777018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.777018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.777018] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.777018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.777018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.777018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.777646] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.777969] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.778270] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.778464] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.778733] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.778986] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.779188] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.779392] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.800512] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.800680] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 779.800784] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.800958] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.801298] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-922f3a41-2718-400c-822e-b238781973a6 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.801467] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.801630] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.802044] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.802231] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922f3a41-2718-400c-822e-b238781973a6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.841322] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.841499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.841600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.842269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.842269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.842269] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 is going to be created. [ 779.856488] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.856709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.856817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.857125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.884356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.884356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.884356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.884841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.884841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.890997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.891266] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.891373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.891415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.891999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.892236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.892937] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be updated. [ 779.894891] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: UNINITIALIZED for 2s [ 779.918996] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.919248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.919373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.919857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.920111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.935841] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.935841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.935841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.936085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.936454] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.936454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.936454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.936640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.936727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.936819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.936966] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.937084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.937142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.937274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.937413] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.937928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.937928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.937928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.937928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.937928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.937928] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.939808] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 780.147056] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7: rpc.has_security_group_logging(os_id): False [ 780.165881] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.166058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.166131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.166341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.186868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.187352] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.187545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.187660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.187956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.188106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.188427] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.188585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.188688] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.188932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.189072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.189463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.189678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.189715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.189932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.190075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.191417] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 780.272865] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.272865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.272865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.272865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.272865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.290023] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 780.304999] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.305265] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.305408] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.305709] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.306633] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.306633] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 922f3a41-2718-400c-822e-b238781973a6 not found, creating... [ 780.306633] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.306633] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.306633] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.306871] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.306947] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.307293] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.307443] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.307578] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.307799] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.307942] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.308136] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 922f3a41-2718-400c-822e-b238781973a6 is going to be created. [ 780.349462] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.349462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.349462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.349462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.349462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.349462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.445861] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f8fa77-dfd6-4877-84c2-f9760d23fdfb: rpc.has_security_group_logging(os_id): False [ 780.467880] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.469271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.469407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.470137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.500049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.500049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.500049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.500049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.500049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.500049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.500558] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.500558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.500558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.500679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.500679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.500895] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.500977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.501049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.501233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.501350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.501458] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 780.583022] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.583356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.583432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.583815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.584177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.600634] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 781.116988] env[65788]: INFO networking_nsxv3.common.synchronization [req-7f99bbff-b2c9-4bbd-88ec-16c70dc21fac req-a712dac9-70b2-4ecb-993a-837591742f13 service nova] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_rules [ 781.116988] env[65788]: INFO networking_nsxv3.common.synchronization [req-7f99bbff-b2c9-4bbd-88ec-16c70dc21fac req-a712dac9-70b2-4ecb-993a-837591742f13 service nova] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 781.116988] env[65788]: INFO networking_nsxv3.common.synchronization [req-7f99bbff-b2c9-4bbd-88ec-16c70dc21fac req-a712dac9-70b2-4ecb-993a-837591742f13 service nova] Enqueued Resource ID: 922f3a41-2718-400c-822e-b238781973a6 with Priority: HIGHEST for action port [ 781.116988] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_rules [ 781.117383] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 781.117383] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 922f3a41-2718-400c-822e-b238781973a6 with Priority: HIGHEST for action port [ 781.118598] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.118598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.118598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.118598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.118598] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.119117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.120037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.120282] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-922f3a41-2718-400c-822e-b238781973a6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.120412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.120456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.121215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.121215] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922f3a41-2718-400c-822e-b238781973a6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.623335] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.623615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.623615] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 922f3a41-2718-400c-822e-b238781973a6 with status ACTIVE [ 781.623813] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.623936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.624014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.624431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.624496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.624694] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.624802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.624917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.625059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.625145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.625335] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.625510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.625579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.625726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.625812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.625913] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 922f3a41-2718-400c-822e-b238781973a6 is going to be updated. [ 781.647473] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.647615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.647615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.647822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.647947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.648121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-922f3a41-2718-400c-822e-b238781973a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.905696] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: SUCCESS [ 781.905696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.905892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.905953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.906229] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.907051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.907051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.907051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.907051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.907051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.907051] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.950091] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 781.950091] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e deletion is rescheduled due to dependency. [ 781.950324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.950368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.950592] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.950835] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.951152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.951238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.951434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.951556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.951694] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.305504] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 782.305732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.409492] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.455058] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.618258] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 782.618514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.912990] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4b5aad8-d35c-4b10-8b3c-acf71725fec6: rpc.has_security_group_logging(os_id): False [ 782.932968] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.936713] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.936713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.936713] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 is going to be created. [ 782.956982] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.004211] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.004871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.004871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.004871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.004871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.020307] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: IN_PROGRESS for 2s [ 783.251063] env[65788]: INFO networking_nsxv3.common.synchronization [req-02d171c1-4371-4813-a338-b4a4fef7f27a req-e71cdfb9-9218-45d3-bfed-35d46cf8e0b4 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 783.251673] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 783.251978] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.252252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.252325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.252523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.252764] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.252869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.252933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.253100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.253202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.253301] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.459647] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.459882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.459968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.460262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.460304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.460389] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be updated. [ 783.498736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.498736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.498736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.498736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.498736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.508505] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 783.755267] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.755721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.755968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.758613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.803900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.803900] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.803900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.803900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.803900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.803900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.803900] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 783.834409] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.834409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.834409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.834409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.834409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.844864] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 785.036850] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: SUCCESS [ 785.036850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.521279] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 785.521503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.522893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.522893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.522893] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.522893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.522893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.522893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.522893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.522893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.522893] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.856041] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 785.856221] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 785.856263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.025619] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.025822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.025903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.026188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.026643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.026643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.026765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.026893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.027033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.027203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.027382] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.027567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.027621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.027779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.027929] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.028068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.028132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.028332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.028427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.028536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.028649] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.531840] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 312ecf31-d6a5-4636-8de5-71be8f37e76e: rpc.has_security_group_logging(os_id): False [ 786.552275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.552427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.552513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.552753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.552851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.553092] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.553215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.553278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.553445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.553529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.553730] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.553835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.553906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.554411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.554523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.554729] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.554891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.554891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.555063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.555138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.555242] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be updated. [ 786.641052] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.641278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.641482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.641810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.641982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.656676] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 787.576038] env[65788]: INFO networking_nsxv3.common.synchronization [req-b77f192a-1b02-4b84-a862-d06c6169b8f3 req-e180e359-4bc2-4732-b399-4f561b640baa tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 787.576670] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 787.577391] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.577603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.577711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.578062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.578250] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.578391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.578485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.578804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.578942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.579317] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.082024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.082024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.082024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.082229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.082307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.082558] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.082609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.082667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.082823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.082900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.082985] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 already deleted. [ 788.083079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.126295] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.126433] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-785" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.126473] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-785" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.126786] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-785" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.127065] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.127888] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.127888] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.127888] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.127888] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.127888] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.128121] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.128121] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.128192] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.128338] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.128338] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.128466] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.151541] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.151816] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.152133] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.152249] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-785" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.152604] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-979de45a-6514-49fc-be68-6f53402f7f77 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.152784] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.152928] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.153272] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.153427] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979de45a-6514-49fc-be68-6f53402f7f77',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.582872] env[65788]: INFO networking_nsxv3.common.synchronization [req-4d2068b9-6ed9-4b1f-a815-28190ca2fa90 req-141e0d09-27ff-4764-af81-f8e180e3705a tempest-FloatingIPsAssociationTestJSON-899504544 tempest-FloatingIPsAssociationTestJSON-899504544-project-member] Enqueued Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 788.583447] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17bee3e-2368-47f5-851f-96deb4d04a56 with Priority: HIGHEST for action security_group_members [ 788.583782] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17bee3e-2368-47f5-851f-96deb4d04a56 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.583914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.584010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.584677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.584861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.584981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.585056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.585209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.585298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.585392] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17bee3e-2368-47f5-851f-96deb4d04a56',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.656371] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.656642] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.656792] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.657107] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.657256] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.657407] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 979de45a-6514-49fc-be68-6f53402f7f77 not found, creating... [ 788.657676] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.657825] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.657994] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.658192] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.658326] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.659475] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.659475] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.659475] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.659475] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.659475] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.659475] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 979de45a-6514-49fc-be68-6f53402f7f77 is going to be created. [ 788.689747] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 788.690027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.695911] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.696138] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.696262] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.696524] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.696747] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.696964] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.087478] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.087478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.087878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.087878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.111950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.112202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.112720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.112720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.112720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.112860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.112907] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 is going to be updated. [ 789.145761] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.145959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.146040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.146287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.146439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.159874] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: IN_PROGRESS for 2s [ 789.400159] env[65788]: INFO networking_nsxv3.common.synchronization [req-b77f192a-1b02-4b84-a862-d06c6169b8f3 req-a108a752-81b4-4037-924b-ba3106e7ac84 service nova] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 789.400159] env[65788]: INFO networking_nsxv3.common.synchronization [req-b77f192a-1b02-4b84-a862-d06c6169b8f3 req-a108a752-81b4-4037-924b-ba3106e7ac84 service nova] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 789.400298] env[65788]: INFO networking_nsxv3.common.synchronization [req-b77f192a-1b02-4b84-a862-d06c6169b8f3 req-a108a752-81b4-4037-924b-ba3106e7ac84 service nova] Enqueued Resource ID: 979de45a-6514-49fc-be68-6f53402f7f77 with Priority: HIGHEST for action port [ 789.400766] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 789.400896] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 789.400995] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979de45a-6514-49fc-be68-6f53402f7f77 with Priority: HIGHEST for action port [ 789.404634] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.404802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.405130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.405202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.405288] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.406244] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.406379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.406434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.406616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.406763] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.406859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.406928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.407075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.407160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.407253] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.409584] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-979de45a-6514-49fc-be68-6f53402f7f77 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.409707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.409778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.409945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.410099] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979de45a-6514-49fc-be68-6f53402f7f77',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.912496] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.913862] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.916881] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 979de45a-6514-49fc-be68-6f53402f7f77 with status ACTIVE [ 789.916881] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.916881] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.916881] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.916881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.917538] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 979de45a-6514-49fc-be68-6f53402f7f77 is going to be updated. [ 789.940830] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.940830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.940830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.941094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.941138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.941339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.425122] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.928599] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.929057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.929057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.929187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.929304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.929416] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be created. [ 790.962055] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.962055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.962055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.962055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.962055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.974508] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: UNINITIALIZED for 2s [ 791.171314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17bee3e-2368-47f5-851f-96deb4d04a56 in Status: SUCCESS [ 791.171314] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17bee3e-2368-47f5-851f-96deb4d04a56 deletion is rescheduled due to dependency. [ 791.171314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17bee3e-2368-47f5-851f-96deb4d04a56" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.468564] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f54a7e44-e5bc-454e-aebc-a6d616249fec None None] Enqueued Resource ID: 8421fd38-8945-4a8d-8674-217ffb3ed9b9 with Priority: HIGHEST for action port [ 792.469748] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8421fd38-8945-4a8d-8674-217ffb3ed9b9 with Priority: HIGHEST for action port [ 792.469748] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8421fd38-8945-4a8d-8674-217ffb3ed9b9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.469748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8421fd38-8945-4a8d-8674-217ffb3ed9b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.469748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8421fd38-8945-4a8d-8674-217ffb3ed9b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.473073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8421fd38-8945-4a8d-8674-217ffb3ed9b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.473073] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8421fd38-8945-4a8d-8674-217ffb3ed9b9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.975329] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8421fd38-8945-4a8d-8674-217ffb3ed9b9 [ 792.975329] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.975329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.975329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.975329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.975647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.975647] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8421fd38-8945-4a8d-8674-217ffb3ed9b9 already deleted. [ 792.975647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8421fd38-8945-4a8d-8674-217ffb3ed9b9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.989158] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 792.992828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.993885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.994501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.994871] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.995177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.995398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.995780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.995992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.996498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.996498] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.502184] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.007247] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 478cab84-cb72-4b89-ac1a-ce3970d7f356: rpc.has_security_group_logging(os_id): False [ 794.029809] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.029809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.029809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.030169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.030169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.030356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.030477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.030513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.030670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.030753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.030863] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be created. [ 794.097184] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.098485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.098619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.098936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.099113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.112449] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 794.755546] env[65788]: INFO networking_nsxv3.common.synchronization [req-1ff2c04c-6afc-483a-8d33-f00edd29009b req-c4bd9467-ae2e-499f-b73e-10071789ecba tempest-ServersV294TestFqdnHostnames-200598053 tempest-ServersV294TestFqdnHostnames-200598053-project-member] Enqueued Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_members [ 794.756723] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGHEST for action security_group_members [ 794.756895] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.757014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.757014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.757296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.757405] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.757505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.757563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.757709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.757847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.757925] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.955029] env[65788]: INFO networking_nsxv3.common.synchronization [req-445269d2-b749-466c-b7d6-ff7ef11ad68f req-2453715c-5e7c-4841-b891-99235b8ad6b2 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 794.955630] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 794.956133] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.956228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.956333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.956981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.956981] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.957087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.957122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.957913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.957913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.957913] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.261456] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.261618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.261761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.262147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.285112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285483] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.285708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.285762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.286062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.286207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.286314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 is going to be updated. [ 795.320179] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.320449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.320525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.320727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.320864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.332898] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 in Status: IN_PROGRESS for 2s [ 795.373477] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.374786] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-565" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.374786] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-565" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.376207] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-565" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.376207] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.376769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.376769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.378389] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.378389] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.378389] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.378389] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.378389] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.378389] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.378389] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.378845] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.380987] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.406672] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.406672] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 795.406672] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.406672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-565" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.406672] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-d66c89db-01df-4eca-b059-4595726fdd89 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.406672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.406672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.406672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.406672] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d66c89db-01df-4eca-b059-4595726fdd89',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.460527] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.460690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.460768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.460985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.461150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.461321] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.461434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.461569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.461751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.461856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.461925] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 already deleted. [ 795.462077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.568760] env[65788]: INFO networking_nsxv3.common.synchronization [req-39d40aa6-8ba5-4897-9a8f-9fb6911cf7e9 req-c97739db-c9e7-47c2-b09d-a6e2af105474 tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 795.569622] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 795.570054] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.570339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.570447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.570810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.570891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.571018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.571103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.571264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.571352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.571460] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.911017] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.911017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.911017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.911017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.911017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.911505] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port d66c89db-01df-4eca-b059-4595726fdd89 not found, creating... [ 795.911505] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.911586] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.911716] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.911960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.912311] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.912382] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.912534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.912626] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.912847] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.912973] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.913119] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: d66c89db-01df-4eca-b059-4595726fdd89 is going to be created. [ 795.937489] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.937683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.937803] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.938215] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.938335] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.938558] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.073482] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.125642] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 796.126410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.269560] env[65788]: INFO networking_nsxv3.common.synchronization [None req-58ac6a6f-4df4-4466-8263-3203ccb3f850 None None] Enqueued Resource ID: e7561588-a92c-4c29-b747-9eade157ad31 with Priority: HIGHEST for action port [ 796.270248] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7561588-a92c-4c29-b747-9eade157ad31 with Priority: HIGHEST for action port [ 796.270561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7561588-a92c-4c29-b747-9eade157ad31 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.270690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7561588-a92c-4c29-b747-9eade157ad31" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.270756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7561588-a92c-4c29-b747-9eade157ad31" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.271022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7561588-a92c-4c29-b747-9eade157ad31" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.271110] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7561588-a92c-4c29-b747-9eade157ad31',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.576069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.640727] env[65788]: INFO networking_nsxv3.common.synchronization [req-445269d2-b749-466c-b7d6-ff7ef11ad68f req-8804ab6c-a658-4c6c-b7a1-78360412af09 service nova] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_rules [ 796.640898] env[65788]: INFO networking_nsxv3.common.synchronization [req-445269d2-b749-466c-b7d6-ff7ef11ad68f req-8804ab6c-a658-4c6c-b7a1-78360412af09 service nova] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 796.641051] env[65788]: INFO networking_nsxv3.common.synchronization [req-445269d2-b749-466c-b7d6-ff7ef11ad68f req-8804ab6c-a658-4c6c-b7a1-78360412af09 service nova] Enqueued Resource ID: d66c89db-01df-4eca-b059-4595726fdd89 with Priority: HIGHEST for action port [ 796.641538] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_rules [ 796.643736] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 796.643825] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d66c89db-01df-4eca-b059-4595726fdd89 with Priority: HIGHEST for action port [ 796.644110] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.644571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.644571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.644571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.644776] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.645745] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.645864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.645903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.646479] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.646647] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.646874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.647500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.647500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.647500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.647500] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.648170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d66c89db-01df-4eca-b059-4595726fdd89 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.648279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.648345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.648753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.648753] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d66c89db-01df-4eca-b059-4595726fdd89',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.773458] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7561588-a92c-4c29-b747-9eade157ad31 [ 796.773686] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.773816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.773889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.774265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.774357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.774457] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7561588-a92c-4c29-b747-9eade157ad31 already deleted. [ 796.775150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7561588-a92c-4c29-b747-9eade157ad31" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.078750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.078750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.079066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.079066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.079125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.079208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 797.109773] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.109900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.109941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.110195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.110344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.120942] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 797.151363] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.151363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.151363] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d66c89db-01df-4eca-b059-4595726fdd89 with status ACTIVE [ 797.151363] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.151363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.151363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.151890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.151890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.151890] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.151890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.151890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.152064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.153035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.153035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.153035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.153035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.153035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.153035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.153035] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d66c89db-01df-4eca-b059-4595726fdd89 is going to be updated. [ 797.154009] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.180970] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.181145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.181217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.181419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.181551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.181752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.344850] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 in Status: SUCCESS [ 797.345671] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 deletion is rescheduled due to dependency. [ 797.345671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.659735] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.161867] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.162206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.162206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.162320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.162400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.162497] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be created. [ 798.187779] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.187962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.188018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.188205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.188369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.199710] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: UNINITIALIZED for 2s [ 799.131804] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 799.131804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.192893] env[65788]: INFO networking_nsxv3.common.synchronization [req-77be93d6-190c-4209-9ccb-c26abf6fd1e1 req-68280712-6bba-426d-b88b-4ccd7f7bcdc5 tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 800.193448] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 800.193757] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.193891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.193959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.194251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.194411] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.194519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.194579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.194727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.194815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.194909] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.209751] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 800.209915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.210338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.210550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.210739] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.210852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.210918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.211070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.211152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.211236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.211325] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.697930] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.697930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.697930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.697930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.698212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.698212] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.698717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.698717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.698717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.698717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.698717] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 800.716154] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.716371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.716440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.716655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.716846] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.716954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.717032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.717221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.717297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.717373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.717579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.717676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.717738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.717881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.718047] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.718138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.718199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.718335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.718412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.718493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.718584] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.735823] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.736290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.736457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.737028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.737263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.750771] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 801.222625] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f8c46ed-a19a-4295-843d-5039cf7be334: rpc.has_security_group_logging(os_id): False [ 801.243211] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.243364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.243441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.243653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.243748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.243935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.244071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.244149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.244248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.244323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.244523] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.244676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.244676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.244810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.244884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.245079] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.245173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.245233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.245376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.245447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.245618] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be created. [ 801.304358] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.304510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.304579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.304783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.304973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.317067] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: IN_PROGRESS for 2s [ 801.870906] env[65788]: INFO networking_nsxv3.common.synchronization [req-49af40b5-de4c-4dcf-8677-bdf1b2e4dd4b req-86ca7432-5d86-4d3a-837f-0f1c56c357d8 tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 801.870906] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 801.870906] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.870906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.870906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.870906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.870906] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.870906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.870906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.870906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.870906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.870906] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.373338] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.373703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.373703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.373890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.374052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.374265] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.374369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.374426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.374584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.374662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.374753] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be updated. [ 802.404096] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.404096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.404096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.404096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.404096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.414604] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 802.763170] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 802.763553] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 802.763663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.335962] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 803.336402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.396778] env[65788]: INFO networking_nsxv3.common.synchronization [req-afac8527-a409-40a3-967c-d5a40c0deade req-a2d15a64-c169-4524-8dd7-0945a877f34b tempest-ServersAdminNegativeTestJSON-2035322777 tempest-ServersAdminNegativeTestJSON-2035322777-project-member] Enqueued Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 803.397592] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ea6710-254c-4bc8-955c-3558da8ea95b with Priority: HIGHEST for action security_group_members [ 803.398386] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ea6710-254c-4bc8-955c-3558da8ea95b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.398581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.398693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.398967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.399207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.399324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.399390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.399619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.399734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.399850] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ea6710-254c-4bc8-955c-3558da8ea95b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.903029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.903029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.903029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.903250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.937129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.937432] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.937768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.937768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.937945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.937989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.938101] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b is going to be updated. [ 804.060865] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.060865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.060865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.060865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.060865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.068615] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: IN_PROGRESS for 2s [ 804.426442] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 804.426747] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e deletion is rescheduled due to dependency. [ 804.426747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.082177] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ea6710-254c-4bc8-955c-3558da8ea95b in Status: SUCCESS [ 806.082511] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ea6710-254c-4bc8-955c-3558da8ea95b deletion is rescheduled due to dependency. [ 806.082511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ea6710-254c-4bc8-955c-3558da8ea95b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.375711] env[65788]: INFO networking_nsxv3.common.synchronization [req-77f489e8-9317-4f68-a524-2502211cc469 req-fc1d6011-08c2-412a-bc13-bf774be23a0d tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 806.376409] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 806.376805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.377033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.377196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.377446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.377781] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.377918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.378181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.378273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.378410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.378558] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.777487] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.777733] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.777795] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.778947] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.779331] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.779569] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.779737] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.780068] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.780246] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.780458] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.780565] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.780724] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.780871] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.780993] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.781153] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.781294] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.801047] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.801047] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.801047] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.801047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.801427] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.801620] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.801795] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.802174] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.802312] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04eed898-d32f-45bb-bf5d-e4c3cf1e96f5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.880625] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.880868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.880868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.881065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.904280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.904604] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.904728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.904819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.905052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.905143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.905237] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 806.935341] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.935593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.935593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.935859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.936101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.946592] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 807.304422] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.304745] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.304963] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.305302] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.306611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.306611] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 not found, creating... [ 807.306611] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.306611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.306611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.306611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.306611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.306867] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.306917] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.306998] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.307338] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.307461] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.308208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 is going to be created. [ 807.329115] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.329115] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.329435] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.329505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.329861] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.330745] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.044540] env[65788]: INFO networking_nsxv3.common.synchronization [None req-353c7cf7-34dc-4d59-aa59-c208d063b34c None None] Enqueued Resource ID: 9e71250a-ef08-47cb-b4e4-7185a5451af2 with Priority: HIGHEST for action port [ 808.045298] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e71250a-ef08-47cb-b4e4-7185a5451af2 with Priority: HIGHEST for action port [ 808.045598] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e71250a-ef08-47cb-b4e4-7185a5451af2 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.045724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e71250a-ef08-47cb-b4e4-7185a5451af2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.045796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e71250a-ef08-47cb-b4e4-7185a5451af2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.046061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e71250a-ef08-47cb-b4e4-7185a5451af2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.046143] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e71250a-ef08-47cb-b4e4-7185a5451af2',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.075383] env[65788]: INFO networking_nsxv3.common.synchronization [req-77f489e8-9317-4f68-a524-2502211cc469 req-4989a26c-450f-46d0-9b01-a07351889ba4 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 808.075560] env[65788]: INFO networking_nsxv3.common.synchronization [req-77f489e8-9317-4f68-a524-2502211cc469 req-4989a26c-450f-46d0-9b01-a07351889ba4 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 808.075690] env[65788]: INFO networking_nsxv3.common.synchronization [req-77f489e8-9317-4f68-a524-2502211cc469 req-4989a26c-450f-46d0-9b01-a07351889ba4 service nova] Enqueued Resource ID: 04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 with Priority: HIGHEST for action port [ 808.076142] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 808.076276] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 808.076373] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 with Priority: HIGHEST for action port [ 808.076639] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.076758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.076826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.077031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.077112] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.078129] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.078129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.078312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.078369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.078424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.078590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.078660] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04eed898-d32f-45bb-bf5d-e4c3cf1e96f5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.547749] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e71250a-ef08-47cb-b4e4-7185a5451af2 [ 808.548770] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.549121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.549234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.549759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.550164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.550487] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e71250a-ef08-47cb-b4e4-7185a5451af2 already deleted. [ 808.550487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e71250a-ef08-47cb-b4e4-7185a5451af2" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.580556] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.580556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.580720] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 with status ACTIVE [ 808.580860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.580969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.581065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.581273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.581362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.581532] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.581854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.581854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.581854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.581943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.582121] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.582213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.582274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.582410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.582487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.582570] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04eed898-d32f-45bb-bf5d-e4c3cf1e96f5 is going to be updated. [ 808.604441] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.604441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.604441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.604441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.604441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.604747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04eed898-d32f-45bb-bf5d-e4c3cf1e96f5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.960836] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 808.961020] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 deletion is rescheduled due to dependency. [ 808.961156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.961313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.961537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.961727] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.961925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.961992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.962166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.962245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.962340] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.466106] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.968845] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.210214] env[65788]: INFO networking_nsxv3.common.synchronization [None req-9621b883-24f0-4bee-ad94-545ba5816ebe None None] Enqueued Resource ID: 3006cb2c-9576-402d-80e0-a7d4d75de6ab with Priority: HIGHEST for action port [ 810.212957] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3006cb2c-9576-402d-80e0-a7d4d75de6ab with Priority: HIGHEST for action port [ 810.214246] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-3006cb2c-9576-402d-80e0-a7d4d75de6ab taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.214246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3006cb2c-9576-402d-80e0-a7d4d75de6ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.214246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3006cb2c-9576-402d-80e0-a7d4d75de6ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.214494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3006cb2c-9576-402d-80e0-a7d4d75de6ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.214618] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3006cb2c-9576-402d-80e0-a7d4d75de6ab',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.473550] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.473756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.473800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.474653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.474653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.474653] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 810.513572] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.513572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.513736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.513876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.514909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.524158] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 810.716819] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3006cb2c-9576-402d-80e0-a7d4d75de6ab [ 810.717070] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.717207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.717279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.717490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.717579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.717681] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3006cb2c-9576-402d-80e0-a7d4d75de6ab already deleted. [ 810.717766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3006cb2c-9576-402d-80e0-a7d4d75de6ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.535525] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 812.535938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.535938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.536094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.536288] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.536411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.536461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.536620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.536830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.536830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.536918] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.039486] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.039715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.039715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.039894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.040089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.040203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.040266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.040418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.040526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.040634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.040772] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.040865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.040922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.041101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.041246] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.041342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.041414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.042189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.042259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.042630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.042630] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.545309] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482328ee-c8ae-447e-af1f-c321cd088282: rpc.has_security_group_logging(os_id): False [ 813.566323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.566517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.566562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.566811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.566933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.567085] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.567173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.567233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.567377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.567453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.567660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.567755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.567851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.568074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.568152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.568348] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.568442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.568502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.568642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.568717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.568802] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 813.629223] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.629410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.629458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.629642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.629786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.643037] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 813.946240] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.946436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.946489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.946705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.946844] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.450054] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.951947] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.215081] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 815.215232] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 815.335654] env[65788]: INFO networking_nsxv3.common.synchronization [req-f067d594-1b06-49c4-81c9-b43ad704b2bf req-a1063a34-f1fb-427e-9ecf-bdd42ba8598b tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 815.336330] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 815.336688] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.337038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.337038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.337310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.337503] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.337666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.337738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.337906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.337997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.338110] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.454745] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 815.455090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 815.660532] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 815.661219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.691653] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.692619] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.692619] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.692619] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.692619] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.692949] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.693108] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.693277] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.693473] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.694016] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.694016] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.694016] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.694016] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.697183] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.697183] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.697183] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.717874] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.717874] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.717874] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.717874] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.718241] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-1af6659d-7a5e-454d-957a-c32152e81177 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.718366] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.718479] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.718797] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.718919] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1af6659d-7a5e-454d-957a-c32152e81177',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.840478] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.840659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.840735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.840988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.841104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.841306] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.841438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.841476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.841612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.841690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.841812] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c already deleted. [ 815.841908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.221149] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.221588] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.221629] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.222460] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.222460] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.222460] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 1af6659d-7a5e-454d-957a-c32152e81177 not found, creating... [ 816.222804] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.222804] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.222995] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.223163] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.223296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.223581] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.223730] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.223818] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.224076] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.224223] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.224360] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 1af6659d-7a5e-454d-957a-c32152e81177 is going to be created. [ 816.249125] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.249335] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.249455] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.249894] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.250041] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.250259] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.397013] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.397281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.397281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.397904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.412899] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 816.413885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.415067] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 816.449025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.449250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.449250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.449591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.454308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.454828] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 816.454905] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.454993] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 816.467112] env[65788]: INFO networking_nsxv3.common.synchronization [req-003fb21a-d0ea-43c1-8130-f34696c8fcd9 req-41ecc281-cdd8-4a6a-ad59-695d5aca3622 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_members [ 816.467286] env[65788]: INFO networking_nsxv3.common.synchronization [req-003fb21a-d0ea-43c1-8130-f34696c8fcd9 req-41ecc281-cdd8-4a6a-ad59-695d5aca3622 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 816.467412] env[65788]: INFO networking_nsxv3.common.synchronization [req-003fb21a-d0ea-43c1-8130-f34696c8fcd9 req-41ecc281-cdd8-4a6a-ad59-695d5aca3622 tempest-SecurityGroupsTestJSON-1846153885 tempest-SecurityGroupsTestJSON-1846153885-project-member] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 816.467934] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGHEST for action security_group_members [ 816.468090] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGHEST for action security_group_members [ 816.468204] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGHEST for action security_group_members [ 816.468573] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-87ec6955-50bb-44ae-8df6-a268d59c67bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.468573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.468770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.468823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.468993] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.469307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.469381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.469530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.469622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.469721] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.470969] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.471100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.471142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.471350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.471496] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.471582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.471654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.471820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.471944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.472009] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.473037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.473180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.473258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.473401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.473658] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.473762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.473827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.473963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.474055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.474143] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.491693] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.491880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.491962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.492180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.493155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.493257] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 816.675721] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.675892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.676014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.676172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.676366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.676559] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 816.743541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.743962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.743962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.744839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.744839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.744839] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 816.744839] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d6c1f029-c9a0-40e2-afd5-a6e6e896f095', '0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7', '6e24ba33-cda5-495d-82c8-aa68e5d0b507', '085c9b80-54e0-49d0-b6fe-47a82ba73bd6', '85cc8a8c-6f5e-4e6e-86f6-c1788101dc44', '05b88372-ae25-44bd-b47b-e818f59c5f00', '428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e', '14dfde5c-711e-462d-8f85-f6fadc780c54', '657a43cf-f5af-40a8-8da7-615eb6b41a78', '4798ea04-8c6d-401c-8b54-65632bb263de', 'a4a3512e-9ee8-46fe-beab-4f7ada600ba3', '87ec6955-50bb-44ae-8df6-a268d59c67bb', '3fca49d1-97b5-45f3-9237-0af8e319bb34', '42357d17-1e70-4140-8be5-5413affdb68e', '471c938d-6085-49dc-9e65-e361b495b859', 'a4b5aad8-d35c-4b10-8b3c-acf71725fec6', 'fe91907a-63e4-4a8f-9178-4a55cb787f15', '4e376ad0-b32e-42c7-bf20-bb1704f19ac8', 'faee84c4-679f-4be6-b6c5-c5e48bba4528', '312ecf31-d6a5-4636-8de5-71be8f37e76e', '1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1', '64f8fa77-dfd6-4877-84c2-f9760d23fdfb', '41bb08da-7387-43a0-b7d4-fffc0c3a3846', '482328ee-c8ae-447e-af1f-c321cd088282', '6e122c7c-4854-48e9-8b30-d71e6fb4283b', 'b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf', '1723657c-045d-4e76-905a-f1602b6cbec4', '60331e89-d7f7-4118-84ff-3c2694ae8888', '605d7441-fa35-48f3-be10-861643ff1c6c', '900e89d4-a148-4692-80f4-3bd065e8007a', 'a40ffece-b7ec-436b-a9b9-603ca8f67c90', '3f8c46ed-a19a-4295-843d-5039cf7be334', '07ea6710-254c-4bc8-955c-3558da8ea95b', 'e17bee3e-2368-47f5-851f-96deb4d04a56', '478cab84-cb72-4b89-ac1a-ce3970d7f356'} {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.744839] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 816.770626] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.770776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.770844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.771101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.771198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.771314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 816.771421] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.771452] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 816.840116] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.840274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.840343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.840550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.841230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.841440] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 816.841518] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.841706] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 816.841706] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 816.841783] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 816.841816] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGH for action security_group_rules [ 816.841906] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGH for action security_group_rules [ 816.841972] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGH for action security_group_rules [ 816.842045] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGH for action security_group_rules [ 816.842109] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGH for action security_group_rules [ 816.842171] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGH for action security_group_rules [ 816.842232] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGH for action security_group_rules [ 816.842293] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGH for action security_group_rules [ 816.842355] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGH for action security_group_rules [ 816.842416] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGH for action security_group_rules [ 816.842516] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGH for action security_group_rules [ 816.842553] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGH for action security_group_rules [ 816.842632] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGH for action security_group_rules [ 816.842632] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGH for action security_group_rules [ 816.842701] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGH for action security_group_rules [ 816.842810] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGH for action security_group_rules [ 816.842810] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGH for action security_group_rules [ 816.842875] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGH for action security_group_rules [ 816.842950] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGH for action security_group_rules [ 816.842994] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGH for action security_group_rules [ 816.843111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.971679] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.971891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.971963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.972206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.975918] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.976062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.976261] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.976344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.992188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.992433] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.992558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.992622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.992876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.992956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.993060] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb is going to be updated. [ 816.994015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.994713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.998728] env[65788]: INFO networking_nsxv3.common.synchronization [req-f067d594-1b06-49c4-81c9-b43ad704b2bf req-0eb206b8-e9de-495a-b9f8-b34c989f234f service nova] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_rules [ 816.998867] env[65788]: INFO networking_nsxv3.common.synchronization [req-f067d594-1b06-49c4-81c9-b43ad704b2bf req-0eb206b8-e9de-495a-b9f8-b34c989f234f service nova] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 816.999014] env[65788]: INFO networking_nsxv3.common.synchronization [req-f067d594-1b06-49c4-81c9-b43ad704b2bf req-0eb206b8-e9de-495a-b9f8-b34c989f234f service nova] Enqueued Resource ID: 1af6659d-7a5e-454d-957a-c32152e81177 with Priority: HIGHEST for action port [ 816.999541] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_rules [ 816.999668] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 816.999773] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af6659d-7a5e-454d-957a-c32152e81177 with Priority: HIGHEST for action port [ 816.999980] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGH for action security_group_rules [ 816.999980] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42357d17-1e70-4140-8be5-5413affdb68e with Priority: HIGH for action security_group_rules [ 817.001056] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGH for action security_group_rules [ 817.001344] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 with Priority: HIGH for action security_group_rules [ 817.001344] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb with Priority: HIGH for action security_group_rules [ 817.001419] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 with Priority: HIGH for action security_group_rules [ 817.001527] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4798ea04-8c6d-401c-8b54-65632bb263de with Priority: HIGH for action security_group_rules [ 817.001584] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGH for action security_group_rules [ 817.001670] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGH for action security_group_rules [ 817.001761] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 with Priority: HIGH for action security_group_rules [ 817.001883] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGH for action security_group_rules [ 817.001972] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 with Priority: HIGH for action security_group_rules [ 817.002059] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 with Priority: HIGH for action security_group_rules [ 817.002362] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.002482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.002547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.002796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.002903] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.004481] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.004620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.004755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.007979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.007979] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.007979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.007979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.007979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.007979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.007979] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.007979] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1af6659d-7a5e-454d-957a-c32152e81177 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.007979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.008430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.008430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.008430] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1af6659d-7a5e-454d-957a-c32152e81177',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.009025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.009130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.009548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.009548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.009548] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.010103] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.010211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.010269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.010429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.010503] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e24ba33-cda5-495d-82c8-aa68e5d0b507',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.011558] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.011663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.011723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.012140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.012140] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.012990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.013109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.013175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.013326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.013398] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.014258] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.014408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.014452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.014569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.014641] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.015455] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faee84c4-679f-4be6-b6c5-c5e48bba4528 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.015553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.015611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.015761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.015848] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faee84c4-679f-4be6-b6c5-c5e48bba4528',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.016957] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.016957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.016957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.017153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.017235] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.018053] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe91907a-63e4-4a8f-9178-4a55cb787f15 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.018159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.018258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.018382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.018458] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe91907a-63e4-4a8f-9178-4a55cb787f15',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.018684] env[65788]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 817.019388] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42357d17-1e70-4140-8be5-5413affdb68e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.019493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.019539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.019676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.019722] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42357d17-1e70-4140-8be5-5413affdb68e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.020633] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.020735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.020805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.020952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.022975] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.022975] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fca49d1-97b5-45f3-9237-0af8e319bb34 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.022975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.022975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.023186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.023186] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fca49d1-97b5-45f3-9237-0af8e319bb34',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.024901] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87ec6955-50bb-44ae-8df6-a268d59c67bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.024901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.024901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.024901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.024901] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87ec6955-50bb-44ae-8df6-a268d59c67bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.025822] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.025822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.025822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.025822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.025822] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a3512e-9ee8-46fe-beab-4f7ada600ba3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.027243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4798ea04-8c6d-401c-8b54-65632bb263de taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.027243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.027243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.027243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.027243] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4798ea04-8c6d-401c-8b54-65632bb263de',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.028408] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.028408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.028408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.028408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.028408] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.029079] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.029181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.029277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.029394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.029464] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.030424] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14dfde5c-711e-462d-8f85-f6fadc780c54 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.030859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.030859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.030859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.030859] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14dfde5c-711e-462d-8f85-f6fadc780c54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.031678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.032153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.032153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.032153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.032153] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.032347] env[65788]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 817.033071] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.033177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.033177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.033318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.033357] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.034374] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.034374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.034374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.034575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.034575] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085c9b80-54e0-49d0-b6fe-47a82ba73bd6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.037822] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.037942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.038024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.038174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.038320] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.038603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.038603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.038603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.038732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.038768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.038823] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.040235] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.040325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.040419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.040536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.040667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.042620] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.043764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.043963] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.044105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.044170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.044317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.044440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.044505] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be updated. [ 817.047198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.047326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.065040] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: IN_PROGRESS for 2s [ 817.076366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.077023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.077023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.077023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.077023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.077336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.077336] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be updated. [ 817.081497] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.082127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.082127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.082127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.082127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.093862] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: IN_PROGRESS for 2s [ 817.115432] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.115582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.115651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.115887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.116114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.127187] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: IN_PROGRESS for 2s [ 817.505469] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.505835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.546417] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1af6659d-7a5e-454d-957a-c32152e81177 with status ACTIVE [ 817.546660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.546795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.546907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.547119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.547198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.547374] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.547475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.547533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.547686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.547760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.547934] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.548052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.548108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.548393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.548393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.548393] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1af6659d-7a5e-454d-957a-c32152e81177 is going to be updated. [ 817.551069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.552447] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.552548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.552598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.553204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.553204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.553204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.553204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.553204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.553471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.553471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.553471] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.553587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.553622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.553738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.553876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.553965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.554038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.554194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.554274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.554357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.554445] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.571033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.571267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.571267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.571434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.571572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.571737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1af6659d-7a5e-454d-957a-c32152e81177" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.584411] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.584616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.584663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.584885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.585065] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.585248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.585248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.585469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.585560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.585650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.585741] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.590198] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.590335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.590380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.590554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.590904] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.590904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.590904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.591067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.591067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.591243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.591243] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.596036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.596164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.596238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.596427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.596580] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.596678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.596741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.596879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.596964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.597131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.597225] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.602797] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.602964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.603039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.603234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.603678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.603678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.603678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.603847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.603898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.603964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.604065] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.604997] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.605126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.605195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.605360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.605508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.605600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.605660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.605796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.605872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.605982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.606101] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.608902] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.609079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.609460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.609460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.609632] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.609777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.609827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.609958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.610053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.610139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.610224] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.624104] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.631845] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.632026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.632026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.632262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.654214] env[65788]: INFO networking_nsxv3.common.synchronization [req-28cda64e-913a-4080-a32d-22d049e2c515 req-8e9d78df-72b7-4bf1-b866-dc9ec08699d1 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_members [ 817.654597] env[65788]: INFO networking_nsxv3.common.synchronization [req-28cda64e-913a-4080-a32d-22d049e2c515 req-8e9d78df-72b7-4bf1-b866-dc9ec08699d1 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 817.655973] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.656148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.657454] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.657589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.658193] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_members [ 817.658390] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 817.659101] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc67cb7-c6a5-47b2-833a-38847f1eb426 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.659262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.659361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.659698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.659911] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.660074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.660177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.660541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.660679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.660823] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.662270] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.662425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.662507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.662717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.662908] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.663057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.663236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.663333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.663444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.663575] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.667015] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.667015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.684009] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.684009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.685045] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.685045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.685603] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.685698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.686460] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.686594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.687307] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.687405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.688122] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.688206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.688961] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.689062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.689794] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 817.690194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.701256] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 817.701256] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.701256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.703508] env[65788]: INFO networking_nsxv3.common.synchronization [req-28cda64e-913a-4080-a32d-22d049e2c515 req-8e9d78df-72b7-4bf1-b866-dc9ec08699d1 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_rules [ 817.703683] env[65788]: INFO networking_nsxv3.common.synchronization [req-28cda64e-913a-4080-a32d-22d049e2c515 req-8e9d78df-72b7-4bf1-b866-dc9ec08699d1 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_members [ 817.703816] env[65788]: INFO networking_nsxv3.common.synchronization [req-28cda64e-913a-4080-a32d-22d049e2c515 req-8e9d78df-72b7-4bf1-b866-dc9ec08699d1 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_rules [ 817.703941] env[65788]: INFO networking_nsxv3.common.synchronization [req-28cda64e-913a-4080-a32d-22d049e2c515 req-8e9d78df-72b7-4bf1-b866-dc9ec08699d1 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 817.704078] env[65788]: INFO networking_nsxv3.common.synchronization [req-28cda64e-913a-4080-a32d-22d049e2c515 req-8e9d78df-72b7-4bf1-b866-dc9ec08699d1 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: d66c89db-01df-4eca-b059-4595726fdd89 with Priority: HIGHEST for action port [ 817.704614] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_rules [ 817.704749] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_rules [ 817.704845] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d66c89db-01df-4eca-b059-4595726fdd89 with Priority: HIGHEST for action port [ 817.704937] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_members [ 817.705035] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 817.705307] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc67cb7-c6a5-47b2-833a-38847f1eb426 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.705426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.705487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.705740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.705822] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.706870] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.706870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.707019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.707113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.707192] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.708206] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d66c89db-01df-4eca-b059-4595726fdd89 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.708206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.708206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.708363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.708363] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d66c89db-01df-4eca-b059-4595726fdd89',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.712468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc67cb7-c6a5-47b2-833a-38847f1eb426 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.712468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.712606] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.712606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.726598] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 817.727188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.727351] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be deleted. [ 817.728649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.728872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.728964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.729404] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 is going to be deleted. [ 817.730148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.730344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.796445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.796600] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a3512e-9ee8-46fe-beab-4f7ada600ba3 is going to be deleted. [ 817.797846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.798079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.869163] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.869163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.870150] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.870395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.874087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.874087] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14dfde5c-711e-462d-8f85-f6fadc780c54 is going to be deleted. [ 817.874087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.874087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.924010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.924210] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be deleted. [ 817.925213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.925460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.971810] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.971964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.981161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.981161] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faee84c4-679f-4be6-b6c5-c5e48bba4528 is going to be deleted. [ 817.984816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.984816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.003485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.004345] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4798ea04-8c6d-401c-8b54-65632bb263de is going to be deleted. [ 818.005216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.005489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.025617] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.025617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.056585] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.056775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.056821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.057053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.057157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.057292] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be created. [ 818.058835] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c1f029-c9a0-40e2-afd5-a6e6e896f095: rpc.has_security_group_logging(os_id): False [ 818.076543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.076682] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42357d17-1e70-4140-8be5-5413affdb68e is going to be deleted. [ 818.077653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.077906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.097207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.097207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.097207] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.098170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.098298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.098356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.098704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.098810] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.098902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.098979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.099645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.099742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.099839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.100161] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.100284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.102356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.102356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.102356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.102356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.102356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.102356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.102356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.102356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.102356] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.118939] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.119243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.120500] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.120624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.120725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.120908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.121080] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.121175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.121236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.121379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.121464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.121552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.121699] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.121846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.121916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.122086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.122229] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.122329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.122383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.122517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.122597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.122679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.122771] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.124984] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.127010] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.127208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.127208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.127408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.127576] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.127673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.127734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.127881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.127965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.128063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.128353] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.128719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.128719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.128719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.129224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.129328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.129435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.129600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.129684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.129821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.129966] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.131688] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4b5aad8-d35c-4b10-8b3c-acf71725fec6: rpc.has_security_group_logging(os_id): False [ 818.158242] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b7340ee-6783-43cf-acc9-e6ff52d96460 req-c4841179-8bc6-4a2b-9407-6cd5d647e66d tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_members [ 818.158808] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_members [ 818.159148] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.159419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.159419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.161037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.161037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.161037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.161037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.161037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.161037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.161037] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.165993] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.167354] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.182833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.183010] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe91907a-63e4-4a8f-9178-4a55cb787f15 is going to be deleted. [ 818.184275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.184522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.187045] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.187210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.188774] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.188774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.191370] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.191521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.191564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.191752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.191930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.211556] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: UNINITIALIZED for 2s [ 818.212822] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.212961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.213690] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d66c89db-01df-4eca-b059-4595726fdd89 with status ACTIVE [ 818.213690] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.213690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.213690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.213690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.214127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.214127] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.214127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.214127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.214345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.214345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.214438] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.214522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.214590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.214721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.214825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.214921] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d66c89db-01df-4eca-b059-4595726fdd89 is going to be updated. [ 818.216254] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc67cb7-c6a5-47b2-833a-38847f1eb426 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.216254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.216407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.216655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.234896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.234896] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e24ba33-cda5-495d-82c8-aa68e5d0b507 is going to be deleted. [ 818.236135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.236367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.286390] env[65788]: INFO networking_nsxv3.common.synchronization [req-a0d93e7c-7c94-41e7-b989-46f274ec63f0 req-39991e40-47e3-443a-8f3f-f6ce9c215ba2 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_members [ 818.287919] env[65788]: INFO networking_nsxv3.common.synchronization [req-a0d93e7c-7c94-41e7-b989-46f274ec63f0 req-39991e40-47e3-443a-8f3f-f6ce9c215ba2 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 818.287919] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 with Priority: HIGHEST for action security_group_members [ 818.287919] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 818.287919] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc67cb7-c6a5-47b2-833a-38847f1eb426 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.287919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.287919] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.287919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.291940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.291940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.306419] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.307171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.307307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.307539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.307864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.307864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.318312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.318465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.320809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.320980] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fca49d1-97b5-45f3-9237-0af8e319bb34 is going to be deleted. [ 818.322170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.322474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.322550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.322635] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb is going to be deleted. [ 818.323486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.323761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.323761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.323848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 is going to be deleted. [ 818.325152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.325460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.325460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.325643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.326375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.326578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.326673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.326838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.327490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.327618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.327618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.327808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a3512e-9ee8-46fe-beab-4f7ada600ba3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.327928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.328115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.328212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.328342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14dfde5c-711e-462d-8f85-f6fadc780c54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.328468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.328734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.328734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.328873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.328954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.329062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.343579] env[65788]: INFO networking_nsxv3.common.synchronization [req-a0d93e7c-7c94-41e7-b989-46f274ec63f0 req-39991e40-47e3-443a-8f3f-f6ce9c215ba2 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_rules [ 818.343916] env[65788]: INFO networking_nsxv3.common.synchronization [req-a0d93e7c-7c94-41e7-b989-46f274ec63f0 req-39991e40-47e3-443a-8f3f-f6ce9c215ba2 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 818.343916] env[65788]: INFO networking_nsxv3.common.synchronization [req-a0d93e7c-7c94-41e7-b989-46f274ec63f0 req-39991e40-47e3-443a-8f3f-f6ce9c215ba2 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: d66c89db-01df-4eca-b059-4595726fdd89 with Priority: HIGHEST for action port [ 818.344629] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_rules [ 818.344806] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 818.344902] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d66c89db-01df-4eca-b059-4595726fdd89 with Priority: HIGHEST for action port [ 818.345361] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.345361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.345581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.345581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.345751] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d66c89db-01df-4eca-b059-4595726fdd89 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.346376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.346376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.346376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.346376] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d66c89db-01df-4eca-b059-4595726fdd89',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.356297] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.356468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.408588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.408951] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.409153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.409274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.409555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.409699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.409992] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.410175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.410283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.410523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.410761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.410920] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.411101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.411157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.411371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.411470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.411595] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 818.417816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.417816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.417816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.417816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4798ea04-8c6d-401c-8b54-65632bb263de" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.418166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.418293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.418386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.418526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faee84c4-679f-4be6-b6c5-c5e48bba4528" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.418706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.418889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.505738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.506322] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.507028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.507028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.507028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.507460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.507600] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 is going to be updated. [ 818.509523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.509817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.509979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.510748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe91907a-63e4-4a8f-9178-4a55cb787f15" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.510817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.511167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.511291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.511471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e24ba33-cda5-495d-82c8-aa68e5d0b507" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.511688] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.511949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.512066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.512217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42357d17-1e70-4140-8be5-5413affdb68e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.554711] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.554889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.554981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.555234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.555364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.555505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.557992] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.558167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.558167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.558296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.558389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.558504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fca49d1-97b5-45f3-9237-0af8e319bb34" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.566427] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.566627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.566753] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.567107] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.567476] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.567736] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.567788] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.568225] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.568296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.568484] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.568604] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.568870] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.568870] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.568992] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.568992] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.569153] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.581481] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.581707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.581707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.582434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.582434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.582434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.603225] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 657a43cf-f5af-40a8-8da7-615eb6b41a78: rpc.has_security_group_logging(os_id): False [ 818.604471] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b88372-ae25-44bd-b47b-e818f59c5f00: rpc.has_security_group_logging(os_id): False [ 818.621081] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.621311] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.621652] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.621652] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-274" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.622141] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.622333] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.622463] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.622846] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.623108] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.628207] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e376ad0-b32e-42c7-bf20-bb1704f19ac8: rpc.has_security_group_logging(os_id): False [ 818.632575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 471c938d-6085-49dc-9e65-e361b495b859: rpc.has_security_group_logging(os_id): False [ 818.635032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e: rpc.has_security_group_logging(os_id): False [ 818.644945] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.646264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.647037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.647126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.647296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.652658] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.652658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.652658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.652658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.661032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.661203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.663100] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.663357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.667857] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.669415] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.682282] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.682537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.682915] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.683000] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.688089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.688216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.690676] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 818.698475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.699046] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.699046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.699046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.699206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.699316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.699431] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.700266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.700266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.700266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.700266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.700266] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.700266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.700266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.700266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.700717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.700717] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be updated. [ 818.701633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.703123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.727431] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.727431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.775304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.775547] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.775666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.775729] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.775944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.776449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.776449] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.776449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.776449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.776923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.776923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.776923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.776923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.777871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.777980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.778213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.778371] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 818.779576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.780629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.813957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.815032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.815032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.815032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.815032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.815032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.815032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.815310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.815310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.815371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.815403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.815585] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.815673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.815723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.815858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.815928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.816029] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be updated. [ 818.817131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.817292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.845321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.845652] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.845751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.845831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.846103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.846156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.846259] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 is going to be updated. [ 818.847347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.847521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.847660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.848611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.848853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.850090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d66c89db-01df-4eca-b059-4595726fdd89 with status ACTIVE [ 818.850283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.850397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.850475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.850611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.850692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.850865] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.850966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.851061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.851256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.851358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.851674] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.851814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.851923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.852118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.852199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.852301] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d66c89db-01df-4eca-b059-4595726fdd89 is going to be updated. [ 818.904856] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: IN_PROGRESS for 2s [ 818.912204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.912385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.912488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.912767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.912933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.913255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d66c89db-01df-4eca-b059-4595726fdd89" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.919449] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.919449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.929131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.930268] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.930268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.930268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.930552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.930708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.930881] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be updated. [ 818.932801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.933182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.933345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.933766] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.933927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.933995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.934694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.934694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.934694] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 already deleted. [ 818.934900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.935446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.935531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.935779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.964256] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.964441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.964500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.964748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.964967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.971196] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.971196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.971196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.971481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.971481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.974947] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.975099] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.975185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.975414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.975572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.986176] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: IN_PROGRESS for 2s [ 818.986972] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 818.987848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: IN_PROGRESS for 2s [ 818.994399] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: IN_PROGRESS for 2s [ 819.085894] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb in Status: SUCCESS [ 819.086294] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87ec6955-50bb-44ae-8df6-a268d59c67bb deletion is rescheduled due to dependency. [ 819.086571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87ec6955-50bb-44ae-8df6-a268d59c67bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.112289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.112485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.112525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.112732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.112930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.125828] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 in Status: SUCCESS [ 819.126301] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085c9b80-54e0-49d0-b6fe-47a82ba73bd6 deletion is rescheduled due to dependency. [ 819.126301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085c9b80-54e0-49d0-b6fe-47a82ba73bd6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.126815] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.127075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.127167] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.127441] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.127583] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.127731] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 not found, creating... [ 819.128020] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.128198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.128313] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.128559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.128698] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.129019] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.129179] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.129294] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.129530] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.129669] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.129847] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 is going to be created. [ 819.132751] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: IN_PROGRESS for 2s [ 819.150016] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 in Status: SUCCESS [ 819.150246] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7 deletion is rescheduled due to dependency. [ 819.150379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b3c8765-7e28-4a71-9cd5-1ec4cb5803c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.171276] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.171533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.171533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.171750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.171925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.172118] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 is going to be created. [ 819.173882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.174104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.174200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.174410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.174556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.174738] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be updated. [ 819.178790] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.179119] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.179233] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.179442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.179898] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.180199] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.225078] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.225359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.225359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.225517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.225706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.238765] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.238922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.238968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.239201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.239343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.241188] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 in Status: UNINITIALIZED for 2s [ 819.251929] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: IN_PROGRESS for 2s [ 819.846508] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b7340ee-6783-43cf-acc9-e6ff52d96460 req-192f6f54-d0a2-4bcd-9ab5-78496a228f37 service nova] Enqueued Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_rules [ 819.846778] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b7340ee-6783-43cf-acc9-e6ff52d96460 req-192f6f54-d0a2-4bcd-9ab5-78496a228f37 service nova] Enqueued Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_members [ 819.846900] env[65788]: INFO networking_nsxv3.common.synchronization [req-5b7340ee-6783-43cf-acc9-e6ff52d96460 req-192f6f54-d0a2-4bcd-9ab5-78496a228f37 service nova] Enqueued Resource ID: d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 with Priority: HIGHEST for action port [ 819.847366] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_rules [ 819.847508] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_members [ 819.847604] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 with Priority: HIGHEST for action port [ 819.847889] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.848028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.848113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.848293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.848374] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.849249] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.849375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.849447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.850029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.850029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.850029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.850029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.850230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.850230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.850321] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.851724] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.851931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.851965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.852138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.852217] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.228866] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: SUCCESS [ 820.229115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.229295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.229615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.229826] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.229826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.230114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.230114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.230222] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.230222] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.230320] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.355081] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.355598] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.355936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.357217] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 with status ACTIVE [ 820.357217] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.357217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.357217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.357217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.357217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.357217] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.357664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.357664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.358001] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.358001] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.358801] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.358801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.358801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.358801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.358801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.358801] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9 is going to be updated. [ 820.384299] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.384439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.384533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.384720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.384855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.385030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d67cf5bc-b2cc-40fe-a062-d4e3b59ae6a9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.709450] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 820.709845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.736036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.736036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.736036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.736036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.736728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.736728] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.736728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.736728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.736913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.736971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.737133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.737253] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.819440] env[65788]: INFO networking_nsxv3.common.synchronization [req-e78d1644-cc8c-4353-95f5-cc5f1a92dd63 req-892de08b-c782-42d1-9d48-efd98ff0f4a1 tempest-ServersNegativeTestJSON-1756087549 tempest-ServersNegativeTestJSON-1756087549-project-member] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 820.820151] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 820.820529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.821029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.821029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.821188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.821445] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.821625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.821901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.822037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.822266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.822307] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.856777] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.921265] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: SUCCESS [ 820.921627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.011581] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: SUCCESS [ 821.011872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.012696] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 821.013560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.013698] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 821.013781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.015035] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 821.015035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.148576] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 821.148893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.240422] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 975f007e-412c-4399-9443-27166cb23d7c: rpc.has_security_group_logging(os_id): False [ 821.257764] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 in Status: SUCCESS [ 821.258146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.258146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.259301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.259301] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.259301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.259301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.259680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.259680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.259680] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.264379] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.264379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.264379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.264379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.264379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.264379] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.264379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.264379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.264379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.264921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.264921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.264921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.264921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.264921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.265333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.265333] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.265333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.265333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.265556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.265556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.265700] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be created. [ 821.268573] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 821.268573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.268869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.269078] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.269240] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.269589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.269589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.269589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.269813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.269813] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.324585] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.339164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.339308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.339553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.339618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.339793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.353648] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: IN_PROGRESS for 2s [ 821.360460] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.360460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.360460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.360460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.360460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.360460] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 is going to be created. [ 821.404860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.405011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.405088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.405305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.405464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.426172] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.426439] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.426601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.426962] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.427401] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.427657] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.427884] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.428313] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.428564] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.428797] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.428926] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.429093] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.429230] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.429354] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.429482] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.429668] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.438438] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 in Status: UNINITIALIZED for 2s [ 821.456216] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.456216] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.456216] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.456470] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.456727] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.456901] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.457032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.458052] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.458052] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2abc9a3-d67f-45a2-b5ce-4bef52f912bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.762626] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.762857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.763201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.763468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.763616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.763884] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.764085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.764196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.764395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.764518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.764646] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 is going to be deleted. [ 821.773520] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.803208] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.803418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.803475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.803663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.803756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.803855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.804035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.804268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.804442] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.804609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.804609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.804800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.804938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.808954] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.827643] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.960903] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.961302] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.961302] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.961718] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.961757] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.962092] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port b2abc9a3-d67f-45a2-b5ce-4bef52f912bb not found, creating... [ 821.962455] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.962728] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.962982] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.963349] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.963757] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.964310] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.964636] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.964885] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.965209] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.965455] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.965675] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: b2abc9a3-d67f-45a2-b5ce-4bef52f912bb is going to be created. [ 821.990745] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.990964] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.991051] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.991384] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.991623] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.991926] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.275864] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.314082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.314082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.314082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.314082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.314082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.314082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.314082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.314082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.316060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.316833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.317211] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 already deleted. [ 822.317543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.318915] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.323417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.323417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.324140] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.324528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.326081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.326081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.326081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.326081] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.329666] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.331474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.331474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.331474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.331474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.331474] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 822.368231] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.368231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.368231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.368231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.368231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.376165] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 822.726874] env[65788]: INFO networking_nsxv3.common.synchronization [req-e78d1644-cc8c-4353-95f5-cc5f1a92dd63 req-7fd658fc-d268-4108-8c28-75ab4152f83d service nova] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_rules [ 822.726874] env[65788]: INFO networking_nsxv3.common.synchronization [req-e78d1644-cc8c-4353-95f5-cc5f1a92dd63 req-7fd658fc-d268-4108-8c28-75ab4152f83d service nova] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 822.726874] env[65788]: INFO networking_nsxv3.common.synchronization [req-e78d1644-cc8c-4353-95f5-cc5f1a92dd63 req-7fd658fc-d268-4108-8c28-75ab4152f83d service nova] Enqueued Resource ID: b2abc9a3-d67f-45a2-b5ce-4bef52f912bb with Priority: HIGHEST for action port [ 822.727776] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_rules [ 822.728360] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 822.732020] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2abc9a3-d67f-45a2-b5ce-4bef52f912bb with Priority: HIGHEST for action port [ 822.732020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.732020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.732020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.732020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.732020] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.732020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.732020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.732020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.732020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.732020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.732020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.732020] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2abc9a3-d67f-45a2-b5ce-4bef52f912bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.780129] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.780323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.780382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.780626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.780717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.780770] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be updated. [ 822.817404] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.818491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.818491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.818491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.818693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.823578] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bc67cb7-c6a5-47b2-833a-38847f1eb426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.835019] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: IN_PROGRESS for 2s [ 822.835286] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.835286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.835438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.835589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.835679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.835944] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.836488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.836488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.836488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.836488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.836694] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 already deleted. [ 822.836694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.235211] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.235538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.235612] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2abc9a3-d67f-45a2-b5ce-4bef52f912bb with status ACTIVE [ 823.235861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.235935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.236060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.236340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.236454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.236616] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.237036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.237036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.237036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.237183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.237418] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.237539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.237625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.237934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.238029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.238123] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2abc9a3-d67f-45a2-b5ce-4bef52f912bb is going to be updated. [ 823.263238] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.263463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.263463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.263685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.263792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.263955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2abc9a3-d67f-45a2-b5ce-4bef52f912bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.330213] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bc67cb7-c6a5-47b2-833a-38847f1eb426: rpc.has_security_group_logging(os_id): False [ 823.352229] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.352388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.352514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.352941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.354552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.354552] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.354552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.354552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.354552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.354552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.354552] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 is going to be created. [ 823.371685] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: SUCCESS [ 823.371990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.403202] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0bc67cb7-c6a5-47b2-833a-38847f1eb426], does not exist path=[/infra/domains/default/groups/0bc67cb7-c6a5-47b2-833a-38847f1eb426]."\n}' [ 823.403202] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0bc67cb7-c6a5-47b2-833a-38847f1eb426 [ 823.403202] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 823.449210] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 in Status: SUCCESS [ 823.450694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.450694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.450694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.450694] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.450694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.450694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.451026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.451026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.451026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.451137] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.501954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.502161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.503018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.503018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.503308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.503593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.503703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.503773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.504023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.504106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504282] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.504397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.504459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.504617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.504743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504797] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc67cb7-c6a5-47b2-833a-38847f1eb426 is going to be created. [ 823.533883] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0bc67cb7-c6a5-47b2-833a-38847f1eb426], does not exist path=[/infra/domains/default/groups/0bc67cb7-c6a5-47b2-833a-38847f1eb426]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0bc67cb7-c6a5-47b2-833a-38847f1eb426 [ 823.534196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc67cb7-c6a5-47b2-833a-38847f1eb426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.534485] env[65788]: Traceback (most recent call last): [ 823.534485] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 823.534485] env[65788]: return func(*args, **kwargs) [ 823.534485] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 823.534485] env[65788]: res.raise_for_status() [ 823.534485] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 823.534485] env[65788]: raise HTTPError(http_error_msg, response=self) [ 823.534485] env[65788]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0bc67cb7-c6a5-47b2-833a-38847f1eb426 [ 823.534485] env[65788]: During handling of the above exception, another exception occurred: [ 823.534485] env[65788]: Traceback (most recent call last): [ 823.534485] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 823.534485] env[65788]: listener.cb(fileno) [ 823.535011] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 823.535011] env[65788]: result = function(*args, **kwargs) [ 823.535011] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 823.535011] env[65788]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 823.535011] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 823.535011] env[65788]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 823.535011] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 823.535011] env[65788]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 823.535011] env[65788]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 823.535011] env[65788]: res.raise_for_status() [ 823.535011] env[65788]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 823.535011] env[65788]: raise HTTPError(http_error_msg, response=self) [ 823.535011] env[65788]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0bc67cb7-c6a5-47b2-833a-38847f1eb426 [ 823.535011] env[65788]: Removing descriptor: 65 [ 823.953729] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.389208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 824.389530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.389639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.389876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.390073] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.390197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.390265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.390415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.390512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.390587] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.455931] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c9eb1a7-b6ab-4c36-9698-fa5d64155721: rpc.has_security_group_logging(os_id): False [ 824.488118] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.488210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.488246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.488447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.488573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.488873] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.489019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.489063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.489204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.489302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.489434] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 is going to be created. [ 824.574215] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.574215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.574215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.574215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.574396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.589128] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 in Status: IN_PROGRESS for 2s [ 824.848056] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 824.848395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.848533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.850390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.850390] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.850390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.850390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.850390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.850390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.850390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.850390] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.853393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.854026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.854026] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.854232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.854232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.854812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.854812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.854812] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.893457] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.357563] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.357563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.357563] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.400142] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.859550] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.905559] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.905774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.905834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.906049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.906257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.906257] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 825.945127] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.945330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.945491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.945616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.945803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.962417] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 826.362285] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.362500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.362500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.362750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.362881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.363037] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be updated. [ 826.398673] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.398967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.399128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.399409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.399564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.410127] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: IN_PROGRESS for 2s [ 826.605188] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 in Status: SUCCESS [ 826.605551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.792780] env[65788]: INFO networking_nsxv3.common.synchronization [req-71d56224-ac74-40ee-b362-cf0e0c5b2e63 req-71526111-d251-4c15-a1c8-eb5e51b26a82 tempest-ServerRescueTestJSONUnderV235-569169363 tempest-ServerRescueTestJSONUnderV235-569169363-project-member] Enqueued Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 826.793417] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 with Priority: HIGHEST for action security_group_members [ 826.793731] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.793829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.478160] env[65788]: INFO networking_nsxv3.common.synchronization [req-45a7f1cf-c907-4d55-b65e-3601d9177a86 req-f7b49110-db73-4d2f-8d66-1d19fcf47777 tempest-ServersWithSpecificFlavorTestJSON-1851839051 tempest-ServersWithSpecificFlavorTestJSON-1851839051-project-member] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 827.479016] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 827.479451] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.479451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.479451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.479821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.479861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.480757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.480757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.480757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.480757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.480757] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.973576] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.978571] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.978571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.978571] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.984039] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.984454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.984454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.984578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.038993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.039346] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.039547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.039547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.039769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.039922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.040014] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be updated. [ 828.088871] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.089141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.089141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.089365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.089522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.099725] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: IN_PROGRESS for 2s [ 828.424358] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 828.424358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.424358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.424358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.424358] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.424358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.424358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.424358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.424358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.424358] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.483024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.483353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.483353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.483537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.483682] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.483832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.483928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.484365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.484365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.484498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.484570] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.484658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.484709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.484836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.485087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.485178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.485238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.485432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.486333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.486333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.486333] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.927579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.927701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.927743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.927969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.951721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.954025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.954025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.954025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.954025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.954025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.954025] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be updated. [ 828.987425] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.987864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.988041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.988267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.988521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.989814] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c1f029-c9a0-40e2-afd5-a6e6e896f095: rpc.has_security_group_logging(os_id): False [ 829.011502] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.015670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.015670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.015760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.018164] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: IN_PROGRESS for 2s [ 829.043393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.043728] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.043944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.044052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.044428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.044529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.044790] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.044911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.044973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.045206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.045287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.045503] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.045635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.045696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.046126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.046224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.046319] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 829.134534] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.134723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.134774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.135033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.135198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.155635] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 830.114820] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 830.115158] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 deletion is rescheduled due to dependency. [ 830.115158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.029531] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 831.029816] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 deletion is rescheduled due to dependency. [ 831.030038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.030216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.031081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.031081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.031081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.031081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.031081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.031081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.031392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.031392] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8c46ed-a19a-4295-843d-5039cf7be334 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.031392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.031528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.032452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.032452] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.032452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.032452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.032452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.032452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.032452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.032452] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.033806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.033806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.033914] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.034063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.034121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.034327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.034867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.035360] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.174828] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 831.174828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.537424] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f8c46ed-a19a-4295-843d-5039cf7be334: rpc.has_security_group_logging(os_id): False [ 831.540652] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.541343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.541343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.541343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.541343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.541541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.541541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.541656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.542311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.542311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.542311] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be updated. [ 831.565283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.565283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.565283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.565283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.566117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.566117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.566117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.566117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.566117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.566117] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be updated. [ 831.580827] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.581508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.581508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.581508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.581790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.590470] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: IN_PROGRESS for 2s [ 831.633952] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.634141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.634190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.634415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.634565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.656676] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: IN_PROGRESS for 2s [ 832.480549] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 832.480549] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 833.341020] env[65788]: INFO networking_nsxv3.common.synchronization [req-3b29c3c5-8ece-4638-a4dc-5a5128c4c773 req-ba9c683f-475f-4bea-9a4c-abc9c201cb40 tempest-VolumesAssistedSnapshotsTest-2049452914 tempest-VolumesAssistedSnapshotsTest-2049452914-project-member] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_members [ 833.341166] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGHEST for action security_group_members [ 833.341466] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.341591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.341660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.341856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.342076] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.342192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.342258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.342413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.342500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.342590] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.602134] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 833.602415] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 deletion is rescheduled due to dependency. [ 833.602733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.668754] env[65788]: INFO networking_nsxv3.common.synchronization [req-536b5f9d-f948-498f-a2c4-c26dd9b2e593 req-94f979b2-8648-408b-9582-2e0808dc09b1 tempest-ServersNegativeTestJSON-1756087549 tempest-ServersNegativeTestJSON-1756087549-project-member] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 833.669258] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 833.669585] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.669697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.669770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.670334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.670525] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.670639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.670710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.671380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.671380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.671380] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.672732] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 in Status: SUCCESS [ 833.672964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.673611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.673611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.673736] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8c46ed-a19a-4295-843d-5039cf7be334',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.845523] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.845523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.845680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.845764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.865622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.865954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.866132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.866203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.866461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.866598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.866750] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 is going to be updated. [ 833.896462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.896608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.896680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.896897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.897051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.907006] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: IN_PROGRESS for 2s [ 834.175309] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.195087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.195240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.195327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.196030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.196030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.196030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8c46ed-a19a-4295-843d-5039cf7be334 is going to be deleted. [ 834.258563] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.258563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.258563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.258563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.258563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.258959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8c46ed-a19a-4295-843d-5039cf7be334" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.679057] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.181448] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.181621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.181668] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.181935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.182044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.182156] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 835.210241] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.210392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.210452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.210646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.210788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.220446] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 835.917889] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 in Status: SUCCESS [ 835.918285] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 deletion is rescheduled due to dependency. [ 835.918370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.233979] env[65788]: INFO networking_nsxv3.common.synchronization [req-d835e506-ce7a-456e-a0cb-61e632ef8bd0 req-a20bb723-9505-49bd-8a34-6a781bb88ee6 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 836.234557] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 836.235303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.235455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.235522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.235723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.235878] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.235978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.236058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.236205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.236792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.236792] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.656150] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.657518] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.657518] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.657518] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.657518] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.657720] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.657764] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.657968] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.658194] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.658487] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.658647] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.658877] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.659027] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.659191] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.659448] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.659541] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.685296] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.685296] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.685296] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.685296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.685296] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-cfd02062-6749-43f5-bf9d-0e8361f453a0 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.685296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.685296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.685296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.685296] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd02062-6749-43f5-bf9d-0e8361f453a0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.738857] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.738990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.739085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.739451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.767530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.767854] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.767988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.767988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.768166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.768245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.768335] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 836.797373] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.797530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.797595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.798657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.798657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.809794] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 837.188726] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.189193] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.189255] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.189534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.189701] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.189898] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port cfd02062-6749-43f5-bf9d-0e8361f453a0 not found, creating... [ 837.190272] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.190527] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.190711] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.191026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.191263] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.191833] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.192105] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.192291] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.192583] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.192732] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.192926] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: cfd02062-6749-43f5-bf9d-0e8361f453a0 is going to be created. [ 837.218241] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.218477] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.218580] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.218873] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.219124] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.219357] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.231090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 837.231354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.990192] env[65788]: INFO networking_nsxv3.common.synchronization [req-d835e506-ce7a-456e-a0cb-61e632ef8bd0 req-d4a3ab33-15e4-4419-ba7d-6524ec7ee9e5 service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 837.990377] env[65788]: INFO networking_nsxv3.common.synchronization [req-d835e506-ce7a-456e-a0cb-61e632ef8bd0 req-d4a3ab33-15e4-4419-ba7d-6524ec7ee9e5 service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 837.990496] env[65788]: INFO networking_nsxv3.common.synchronization [req-d835e506-ce7a-456e-a0cb-61e632ef8bd0 req-d4a3ab33-15e4-4419-ba7d-6524ec7ee9e5 service nova] Enqueued Resource ID: cfd02062-6749-43f5-bf9d-0e8361f453a0 with Priority: HIGHEST for action port [ 837.990989] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 837.991556] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 837.992441] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfd02062-6749-43f5-bf9d-0e8361f453a0 with Priority: HIGHEST for action port [ 837.992441] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.992441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.992441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.992441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.992897] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.993994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.993994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.993994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfd02062-6749-43f5-bf9d-0e8361f453a0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.994233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.994233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.994933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.994933] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd02062-6749-43f5-bf9d-0e8361f453a0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.496575] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.496575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.499058] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfd02062-6749-43f5-bf9d-0e8361f453a0 with status ACTIVE [ 838.499058] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.499058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.499058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.499058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.499058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.499529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.499529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.499529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.499529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.499529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.499736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.499794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.499831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.500023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.500110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.500191] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfd02062-6749-43f5-bf9d-0e8361f453a0 is going to be updated. [ 838.525135] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.525135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.525994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.525994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.525994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.525994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfd02062-6749-43f5-bf9d-0e8361f453a0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.820664] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 838.820793] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 838.820870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.821138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.821270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.821539] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.821604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.821677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.821832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.821867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.821990] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.039255] env[65788]: INFO networking_nsxv3.common.synchronization [req-def406b6-8008-4c25-a355-eedc7332a779 req-d597dab9-b315-4e60-bbc1-ebacaf0e2365 tempest-ImagesOneServerTestJSON-1972491077 tempest-ImagesOneServerTestJSON-1972491077-project-member] Enqueued Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_members [ 839.039768] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_members [ 839.040106] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.040274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.040355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.040629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.040819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.040957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.041253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.042120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.042120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.042120] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.325548] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.425014] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.425246] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-517" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.425367] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-517" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.425707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-517" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.425973] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.427040] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.427040] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.427040] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.427040] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.427040] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.427040] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.427413] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.427413] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.427413] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.427577] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.427695] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.450442] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.450622] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.450757] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.450931] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-517" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.451311] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-d52fbb69-871f-48f2-9248-2e90597401c7 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.451498] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.451627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.451956] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.452113] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d52fbb69-871f-48f2-9248-2e90597401c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.545826] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.546132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.546132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.546284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.546373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.546579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.546677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.546740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.546884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.546960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.547057] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c already deleted. [ 839.547443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.831009] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.958026] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.958026] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port d52fbb69-871f-48f2-9248-2e90597401c7 not found, creating... [ 839.958026] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.958026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.958764] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.958764] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.958901] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.959263] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.959490] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.959686] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: d52fbb69-871f-48f2-9248-2e90597401c7 is going to be created. [ 839.982380] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.982627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.982730] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.983021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.983305] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.983453] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.332486] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.332931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.333198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.333543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.333738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.333932] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 840.364471] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.364471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.364471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.364471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.364471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.365806] env[65788]: INFO networking_nsxv3.common.synchronization [None req-2a1a0c99-4b5a-4218-83ac-a84aa7312348 None None] Enqueued Resource ID: 26d4deea-7b16-49ce-8b11-5785434d5ae7 with Priority: HIGHEST for action port [ 840.366408] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d4deea-7b16-49ce-8b11-5785434d5ae7 with Priority: HIGHEST for action port [ 840.367033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d4deea-7b16-49ce-8b11-5785434d5ae7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.367033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d4deea-7b16-49ce-8b11-5785434d5ae7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.367033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d4deea-7b16-49ce-8b11-5785434d5ae7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.367253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d4deea-7b16-49ce-8b11-5785434d5ae7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.367253] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d4deea-7b16-49ce-8b11-5785434d5ae7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.373838] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 840.692265] env[65788]: INFO networking_nsxv3.common.synchronization [req-def406b6-8008-4c25-a355-eedc7332a779 req-7217a64f-7362-45c5-afa0-5636dfbd8e52 service nova] Enqueued Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_rules [ 840.692555] env[65788]: INFO networking_nsxv3.common.synchronization [req-def406b6-8008-4c25-a355-eedc7332a779 req-7217a64f-7362-45c5-afa0-5636dfbd8e52 service nova] Enqueued Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_members [ 840.692555] env[65788]: INFO networking_nsxv3.common.synchronization [req-def406b6-8008-4c25-a355-eedc7332a779 req-7217a64f-7362-45c5-afa0-5636dfbd8e52 service nova] Enqueued Resource ID: d52fbb69-871f-48f2-9248-2e90597401c7 with Priority: HIGHEST for action port [ 840.693138] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_rules [ 840.693274] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_members [ 840.693550] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52fbb69-871f-48f2-9248-2e90597401c7 with Priority: HIGHEST for action port [ 840.693814] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.693814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.693814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.696366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.696366] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.697861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.697861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.698196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.698196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.698329] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.698395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.698434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.699493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.699493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.699493] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.699645] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d52fbb69-871f-48f2-9248-2e90597401c7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.699713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.699713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.699870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.699960] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d52fbb69-871f-48f2-9248-2e90597401c7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.869433] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26d4deea-7b16-49ce-8b11-5785434d5ae7 [ 840.869981] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.870137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.870137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.870626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.870723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.870829] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26d4deea-7b16-49ce-8b11-5785434d5ae7 already deleted. [ 840.870918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d4deea-7b16-49ce-8b11-5785434d5ae7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.198941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.198941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.202294] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.205023] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d52fbb69-871f-48f2-9248-2e90597401c7 with status ACTIVE [ 841.205252] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.205393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.205759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.205759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.205828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.205965] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.206045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.206348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.206348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.206348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.206487] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.206583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.206629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.206766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.206836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.206922] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d52fbb69-871f-48f2-9248-2e90597401c7 is going to be updated. [ 841.228083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.228237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.228302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.228506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.228634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.228785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d52fbb69-871f-48f2-9248-2e90597401c7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.261029] env[65788]: INFO networking_nsxv3.common.synchronization [req-b05a4ef8-cedd-490e-98f4-6a10d8b6d351 req-9757eeed-45ac-4ed8-b578-7a6a324acb01 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 841.261310] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 841.261623] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.261748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.261816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.262091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.262258] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.263101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.263101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.263101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.263101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.263101] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.706581] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.725330] env[65788]: INFO networking_nsxv3.common.synchronization [req-b05a4ef8-cedd-490e-98f4-6a10d8b6d351 req-9757eeed-45ac-4ed8-b578-7a6a324acb01 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 841.725497] env[65788]: INFO networking_nsxv3.common.synchronization [req-b05a4ef8-cedd-490e-98f4-6a10d8b6d351 req-9757eeed-45ac-4ed8-b578-7a6a324acb01 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 841.725631] env[65788]: INFO networking_nsxv3.common.synchronization [req-b05a4ef8-cedd-490e-98f4-6a10d8b6d351 req-9757eeed-45ac-4ed8-b578-7a6a324acb01 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 979de45a-6514-49fc-be68-6f53402f7f77 with Priority: HIGHEST for action port [ 841.726581] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 841.726822] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 841.728416] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979de45a-6514-49fc-be68-6f53402f7f77 with Priority: HIGHEST for action port [ 841.734327] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.734327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.734327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.734327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.734327] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.734327] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.734327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.736968] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-979de45a-6514-49fc-be68-6f53402f7f77 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.737102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.737168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.737364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.737439] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979de45a-6514-49fc-be68-6f53402f7f77',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.744495] env[65788]: INFO networking_nsxv3.common.synchronization [req-7a3ef058-9321-48e4-ba48-7457b00a617d req-c98fe5ad-227f-4a6e-89cb-b6535ae8436c tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 841.745648] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 841.746025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.746163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.746230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.746431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.746587] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.746681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.746735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.746887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.746997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.747162] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.768484] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.208983] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.210208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.210208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.210208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.210208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.210208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c is going to be created. [ 842.239689] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.239689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.239689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.239689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.239689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.246257] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 979de45a-6514-49fc-be68-6f53402f7f77 with status ACTIVE [ 842.246474] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.246594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.246663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.246861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.246947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.247137] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.247234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.247297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.247442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.247520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.247699] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.247796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.247853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.248015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.248062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.248144] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 979de45a-6514-49fc-be68-6f53402f7f77 is going to be updated. [ 842.250371] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.250540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.251504] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.251682] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.251753] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.252100] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.252231] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.253838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.253838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.253838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.253838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.253838] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.253838] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.253838] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.253838] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.253838] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.253838] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.253838] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.257241] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c in Status: UNINITIALIZED for 2s [ 842.257241] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.270155] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.274394] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.275939] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.275939] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.275939] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.275939] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-10ca2d75-cef7-4170-b29a-6df3e17cbaba taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.275939] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.275939] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.276490] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.276719] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ca2d75-cef7-4170-b29a-6df3e17cbaba',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.280067] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.280067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.280067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.280067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.280067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.280067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.388504] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 842.388729] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.388896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.389128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.389323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.389441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.389502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.389659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.389740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.389883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.389970] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.758829] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.773544] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.774507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.774507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.774507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.774507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.774507] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be updated. [ 842.781492] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.781740] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.781819] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.782245] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.782400] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.782694] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 10ca2d75-cef7-4170-b29a-6df3e17cbaba not found, creating... [ 842.782786] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.783171] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.783171] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.783352] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.785010] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.785010] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.785010] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.785010] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.785010] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.785010] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.785010] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 10ca2d75-cef7-4170-b29a-6df3e17cbaba is going to be created. [ 842.817282] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.817282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.817282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.817282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.817282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.817282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.818737] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.819188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.819461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.819875] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.820135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.831318] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 842.896024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.896024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.896024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.896024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.896024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.897102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.897102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.897102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.897645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.897965] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.939341] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e747014b-2d2e-4a41-b10a-355ded2ab68e None None] Enqueued Resource ID: 80323c7b-0717-488d-b2b3-fdd0dc071b65 with Priority: HIGHEST for action port [ 842.941273] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80323c7b-0717-488d-b2b3-fdd0dc071b65 with Priority: HIGHEST for action port [ 842.941273] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-80323c7b-0717-488d-b2b3-fdd0dc071b65 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.941518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80323c7b-0717-488d-b2b3-fdd0dc071b65" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.941813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80323c7b-0717-488d-b2b3-fdd0dc071b65" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.942318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80323c7b-0717-488d-b2b3-fdd0dc071b65" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.943817] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80323c7b-0717-488d-b2b3-fdd0dc071b65',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.028567] env[65788]: INFO networking_nsxv3.common.synchronization [None req-97ed6c4d-9359-4af4-942c-12cd3e596d74 tempest-ServersTestFqdnHostnames-1416237530 tempest-ServersTestFqdnHostnames-1416237530-project-member] Enqueued Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_rules [ 843.028798] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_rules [ 843.029041] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.029168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.029230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.029543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.029606] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.261251] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.261463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.261872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.262098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.262098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.262255] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 843.293576] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.293847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.293924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.294153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.294340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.304741] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 843.402390] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605d7441-fa35-48f3-be10-861643ff1c6c: rpc.has_security_group_logging(os_id): False [ 843.425858] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.426158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.426158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.426346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.426407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.426668] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.426794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.426857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.427022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.427098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.427325] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.427486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.427568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.427696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.427774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.427984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.428093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.428149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.428288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.428362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.428469] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 843.445348] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80323c7b-0717-488d-b2b3-fdd0dc071b65 [ 843.445624] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.445761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.445830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.446048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.446139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.446234] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80323c7b-0717-488d-b2b3-fdd0dc071b65 already deleted. [ 843.446315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80323c7b-0717-488d-b2b3-fdd0dc071b65" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.498675] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.498836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.498888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.499356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.499558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.514688] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 843.529637] env[65788]: INFO networking_nsxv3.common.synchronization [req-7a3ef058-9321-48e4-ba48-7457b00a617d req-41af629f-42dd-4129-a18b-51e5f79da874 service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 843.529862] env[65788]: INFO networking_nsxv3.common.synchronization [req-7a3ef058-9321-48e4-ba48-7457b00a617d req-41af629f-42dd-4129-a18b-51e5f79da874 service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 843.530040] env[65788]: INFO networking_nsxv3.common.synchronization [req-7a3ef058-9321-48e4-ba48-7457b00a617d req-41af629f-42dd-4129-a18b-51e5f79da874 service nova] Enqueued Resource ID: 10ca2d75-cef7-4170-b29a-6df3e17cbaba with Priority: HIGHEST for action port [ 843.530627] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 843.530782] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 843.530887] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ca2d75-cef7-4170-b29a-6df3e17cbaba with Priority: HIGHEST for action port [ 843.531459] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.531637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.532449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.532755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.532872] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.533948] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.534124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.534520] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ca2d75-cef7-4170-b29a-6df3e17cbaba taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.534520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.534708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.534855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.535554] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ca2d75-cef7-4170-b29a-6df3e17cbaba',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.594160] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.594935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.594935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.595172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.595172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.595272] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 already deleted. [ 843.595320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.036661] env[65788]: INFO networking_nsxv3.common.synchronization [None req-2ae8d896-4dfb-41c6-ad55-fef3970eb84f tempest-ServersTestFqdnHostnames-1416237530 tempest-ServersTestFqdnHostnames-1416237530-project-member] Enqueued Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_rules [ 844.036661] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_rules [ 844.036990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.036990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.037122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.037457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.037457] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.038166] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.038285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.042245] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10ca2d75-cef7-4170-b29a-6df3e17cbaba with status ACTIVE [ 844.042438] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.042870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.042870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.042870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.042870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.043106] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.043106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.043184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.043449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.043449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.043634] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.043802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.043884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.044014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.044099] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.044169] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10ca2d75-cef7-4170-b29a-6df3e17cbaba is going to be updated. [ 844.066750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.066750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.066750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.066750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.066750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.067038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ca2d75-cef7-4170-b29a-6df3e17cbaba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.271922] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c in Status: SUCCESS [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.271922] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.271922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.271922] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.562434] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.563066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.563759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.563759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.563759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.563977] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 already deleted. [ 844.563977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.774015] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.774417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.774417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.774596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.774634] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.774818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.774818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.774913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.775009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.775107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.775283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.775355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.775457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.775539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.775720] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.775796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.775836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.775948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.776054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.776113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.776205] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.850848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 844.850951] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.851072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.851425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.851544] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.851628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.851683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.851828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.851913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.852107] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.077026] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f9e466d-b87e-4da6-9c8f-a885608cfff8 req-5ebae1f0-8de6-4c21-ab25-94fb1919adc4 tempest-ServerMetadataNegativeTestJSON-1690454738 tempest-ServerMetadataNegativeTestJSON-1690454738-project-member] Enqueued Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_members [ 845.077026] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_members [ 845.077377] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.077377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.077377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.077578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.077750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.077831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.077896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.078274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.078373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.078470] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.278547] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c: rpc.has_security_group_logging(os_id): False [ 845.297544] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.297718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.297761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.297957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.298072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.298240] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.298343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.298437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.298606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.298677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.298901] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.299024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.299088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.299239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.299321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.299568] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.299702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.299800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.300039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.300154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.300266] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c is going to be created. [ 845.313726] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 845.313952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.314134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.314339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.314542] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.314632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.314684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.314832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.314950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.314998] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.358459] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.362194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.362341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.362411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.362616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.362788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.379024] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c in Status: IN_PROGRESS for 2s [ 845.527837] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 845.528098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.550968] env[65788]: INFO networking_nsxv3.common.synchronization [req-df310054-9eff-4c66-9f8f-692bb4f57d1c req-3f80d922-65d9-44fe-a0ff-f3443b3b2486 tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 845.551621] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 845.552018] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.553316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.553431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.553632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.553809] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.553906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.553968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.554141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.554255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.554451] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.580858] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.580858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.580858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.581266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.581266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.581421] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.581421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.581619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.581619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.582229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.582229] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781561fb-bac5-4326-981f-498051ee7235 already deleted. [ 845.582229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.650844] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.651069] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-550" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.651214] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-550" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.651581] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-550" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.652559] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.652559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.652742] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.652883] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.653081] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.653332] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.653479] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.653616] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.653748] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.653888] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.654083] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.654257] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.673932] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.674147] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 845.674310] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.674535] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-550" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.674828] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-43a2d81d-c9be-436d-94f1-8377aa8e30fd taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.675134] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.675134] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.675452] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.675591] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a2d81d-c9be-436d-94f1-8377aa8e30fd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.817811] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.862114] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.036497] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b5d8252f-45db-4e80-98b9-36bb9795c2d5 None None] Enqueued Resource ID: a32a1a90-87e2-4d92-a987-b19943699b9e with Priority: HIGHEST for action port [ 846.036654] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32a1a90-87e2-4d92-a987-b19943699b9e with Priority: HIGHEST for action port [ 846.036954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a32a1a90-87e2-4d92-a987-b19943699b9e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.037103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a32a1a90-87e2-4d92-a987-b19943699b9e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.037152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a32a1a90-87e2-4d92-a987-b19943699b9e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.037395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a32a1a90-87e2-4d92-a987-b19943699b9e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.037469] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a32a1a90-87e2-4d92-a987-b19943699b9e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.056707] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.182152] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.182577] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.182577] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.182802] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.182967] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.183142] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 43a2d81d-c9be-436d-94f1-8377aa8e30fd not found, creating... [ 846.183421] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.183770] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.183770] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.183907] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.184037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.184314] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.184462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.184573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.184768] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.184893] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.185068] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 43a2d81d-c9be-436d-94f1-8377aa8e30fd is going to be created. [ 846.206793] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.206793] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.206793] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.207117] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.207284] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.207519] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.320715] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.364764] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.364926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.365017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.365232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.365317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.365450] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be updated. [ 846.405042] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.405287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.405414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.405987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.405987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.417769] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 846.539759] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a32a1a90-87e2-4d92-a987-b19943699b9e [ 846.540326] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.540326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.540547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.540720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.540859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.541047] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a32a1a90-87e2-4d92-a987-b19943699b9e already deleted. [ 846.541207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a32a1a90-87e2-4d92-a987-b19943699b9e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.558660] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.823883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.823883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.823883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.824305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.824305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.824458] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 846.857772] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.857998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.857998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.858242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.858414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.868589] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 846.922333] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f9e466d-b87e-4da6-9c8f-a885608cfff8 req-000f1ab2-f5f6-4388-af70-9adcdc28f195 service nova] Enqueued Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_rules [ 846.922333] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f9e466d-b87e-4da6-9c8f-a885608cfff8 req-000f1ab2-f5f6-4388-af70-9adcdc28f195 service nova] Enqueued Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_members [ 846.922333] env[65788]: INFO networking_nsxv3.common.synchronization [req-4f9e466d-b87e-4da6-9c8f-a885608cfff8 req-000f1ab2-f5f6-4388-af70-9adcdc28f195 service nova] Enqueued Resource ID: 43a2d81d-c9be-436d-94f1-8377aa8e30fd with Priority: HIGHEST for action port [ 846.922713] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_rules [ 846.922862] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_members [ 846.922964] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a2d81d-c9be-436d-94f1-8377aa8e30fd with Priority: HIGHEST for action port [ 846.923295] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.923424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.923502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.923749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.923858] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.924844] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.925010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.925110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.925298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.925453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.925550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.925612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.925747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.925876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.925916] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.927029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a2d81d-c9be-436d-94f1-8377aa8e30fd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.927029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.927029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.927301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.927301] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a2d81d-c9be-436d-94f1-8377aa8e30fd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.061095] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.061281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.061324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.061539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.061626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.061722] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 847.093869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.094114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.094114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.094766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.094946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.108058] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 847.401273] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c in Status: SUCCESS [ 847.401273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.429216] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.429216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.429476] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.430560] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43a2d81d-c9be-436d-94f1-8377aa8e30fd with status ACTIVE [ 847.430744] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.430865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.430933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.431196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.431233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.431383] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.431882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.431882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.431882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.431882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.431882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.432768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.432768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.432768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.432768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.432768] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43a2d81d-c9be-436d-94f1-8377aa8e30fd is going to be updated. [ 847.453963] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.454196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.454196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.454470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.454528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.455184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a2d81d-c9be-436d-94f1-8377aa8e30fd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.674825] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-b4126031-3245-4a0c-beed-81b9222dde5f tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 847.675385] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 847.675707] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.675847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.675904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.676822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.676967] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.677107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.677197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.677352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.677440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.677540] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.936148] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.102433] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b285c716-799e-47e4-aec0-65fcaf0f1c3b None None] Enqueued Resource ID: 9cc9f14d-06d2-4d7c-9446-af59c3214287 with Priority: HIGHEST for action port [ 848.103164] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc9f14d-06d2-4d7c-9446-af59c3214287 with Priority: HIGHEST for action port [ 848.103580] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc9f14d-06d2-4d7c-9446-af59c3214287 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.103711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc9f14d-06d2-4d7c-9446-af59c3214287" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.103979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc9f14d-06d2-4d7c-9446-af59c3214287" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.104073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc9f14d-06d2-4d7c-9446-af59c3214287" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.104166] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc9f14d-06d2-4d7c-9446-af59c3214287',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.180662] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.181108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.181211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.181447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.181541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.181754] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.181863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.181923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.182162] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.182254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.182353] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be deleted. [ 848.227938] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.228201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.228288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.228598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.228751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.228917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.233226] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.233448] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.233573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.233873] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.234325] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.234588] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.234782] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.235096] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.235320] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.236039] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.236039] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.236039] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.236039] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.237032] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.237032] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.237032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.260247] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.260441] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.260749] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.260798] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.261197] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-0e206b18-1e1d-4408-96b5-f21b9b865439 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.261425] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.261526] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.261895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.262549] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e206b18-1e1d-4408-96b5-f21b9b865439',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.429111] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 848.429514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.429560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.429916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.430176] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.430381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.430456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.430635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.430722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.430857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.430984] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.441238] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.441502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.441692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.442141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.442141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.442141] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781561fb-bac5-4326-981f-498051ee7235 is going to be created. [ 848.471476] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.471569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.471607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.471857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.472106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.485521] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781561fb-bac5-4326-981f-498051ee7235 in Status: UNINITIALIZED for 2s [ 848.609554] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cc9f14d-06d2-4d7c-9446-af59c3214287 [ 848.609984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.610167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.610223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.610492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.610660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.610735] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cc9f14d-06d2-4d7c-9446-af59c3214287 already deleted. [ 848.610849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc9f14d-06d2-4d7c-9446-af59c3214287" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.766465] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.766465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.766465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.766465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.766799] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.766843] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 0e206b18-1e1d-4408-96b5-f21b9b865439 not found, creating... [ 848.767806] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.767806] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.767806] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.767806] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.768241] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.768299] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.769077] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.769549] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.769708] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.769992] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.770481] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 0e206b18-1e1d-4408-96b5-f21b9b865439 is going to be created. [ 848.804342] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.804522] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.804719] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.805047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.805359] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.805652] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.882396] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 848.882632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.882820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.883164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.883377] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.883501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.883565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.883744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.883837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.883924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.884119] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.937051] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.118121] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 849.118298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.386653] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.387171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.387340] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.387452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.387511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.387630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.387869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.387869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.388052] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.388139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.388213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.388325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.388462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.388552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.388609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.388739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.388814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.388884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.388970] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.436891] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 478cab84-cb72-4b89-ac1a-ce3970d7f356: rpc.has_security_group_logging(os_id): False [ 849.456827] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.456978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.457066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.457268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.476804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.477650] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.477769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.477829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.478141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.478259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.478314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be updated. [ 849.496617] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-924e4243-1455-413a-9855-ce6dad01199c service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 849.496797] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-924e4243-1455-413a-9855-ce6dad01199c service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 849.496930] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-924e4243-1455-413a-9855-ce6dad01199c service nova] Enqueued Resource ID: 0e206b18-1e1d-4408-96b5-f21b9b865439 with Priority: HIGHEST for action port [ 849.497606] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 849.497606] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 849.497858] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e206b18-1e1d-4408-96b5-f21b9b865439 with Priority: HIGHEST for action port [ 849.497949] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.498107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.498156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.498326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.498414] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.499579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.499738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.499815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.500130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.500289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.500390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.500449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.500599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.500680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.500811] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.501549] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e206b18-1e1d-4408-96b5-f21b9b865439 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.501656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.501838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.501926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.501926] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e206b18-1e1d-4408-96b5-f21b9b865439',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.539337] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.539474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.539580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.539921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.540113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.553647] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 849.893308] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1: rpc.has_security_group_logging(os_id): False [ 849.916023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.916023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.916023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.916023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.946337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.946712] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.946909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.946980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.947293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.947429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.947757] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.947888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.947998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.948716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.948716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.949083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.949083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.949259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.949522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.949663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.949871] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 850.005020] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.005020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.005020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.007659] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e206b18-1e1d-4408-96b5-f21b9b865439 with status ACTIVE [ 850.008748] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.010176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.010176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.010176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.010833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.010833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.010986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.011551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.011551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.011551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.012224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.012538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.012538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.013142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.013142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.013142] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e206b18-1e1d-4408-96b5-f21b9b865439 is going to be updated. [ 850.035935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.035935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.035935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.035935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.035935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.044130] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.044130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.044130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.044130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.044130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.044130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e206b18-1e1d-4408-96b5-f21b9b865439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.051719] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 850.261403] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-b90ab212-3d1f-41ab-a896-5bae95b483ad tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 850.262062] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 850.262444] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.262521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.497228] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781561fb-bac5-4326-981f-498051ee7235 in Status: SUCCESS [ 850.497516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.500044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.500044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.500044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.500044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.500044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.500044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.500044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.500044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.500044] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.509797] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.809479] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.809752] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.809892] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.810282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.810569] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.810727] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.810842] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.811875] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.812176] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.812495] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.812675] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.812858] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.813086] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.813290] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.813491] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.813760] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.839882] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.840167] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.840317] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.840492] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-980" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.840807] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-c3ae737b-6a00-4c64-8915-acf95b74f8f4 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.841072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.841148] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.841442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.841576] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ae737b-6a00-4c64-8915-acf95b74f8f4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.952478] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f7a212fa-bd28-46c2-aad0-59a7091470c1 None None] Enqueued Resource ID: 5a31e087-425b-44ea-b9ec-9e51ea0cc7e7 with Priority: HIGHEST for action port [ 850.953050] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a31e087-425b-44ea-b9ec-9e51ea0cc7e7 with Priority: HIGHEST for action port [ 850.954461] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a31e087-425b-44ea-b9ec-9e51ea0cc7e7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.955176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a31e087-425b-44ea-b9ec-9e51ea0cc7e7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.955426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a31e087-425b-44ea-b9ec-9e51ea0cc7e7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.956153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a31e087-425b-44ea-b9ec-9e51ea0cc7e7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.956153] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a31e087-425b-44ea-b9ec-9e51ea0cc7e7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.001711] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.004252] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.004252] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.004252] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.004252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.004870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.004870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.004870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.004870] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.014848] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.014848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.014848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.014848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.014848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.014848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be created. [ 851.043052] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.043052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.043052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.043417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.043608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.057268] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: UNINITIALIZED for 2s [ 851.344373] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.344769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.344953] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.345330] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.345543] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.345776] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port c3ae737b-6a00-4c64-8915-acf95b74f8f4 not found, creating... [ 851.346103] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.346318] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.346449] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.346712] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.346835] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.347140] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.347314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.347398] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.347651] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.348422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.348422] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: c3ae737b-6a00-4c64-8915-acf95b74f8f4 is going to be created. [ 851.373182] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.373448] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.373613] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.374278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.374278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.375206] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.459736] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a31e087-425b-44ea-b9ec-9e51ea0cc7e7 [ 851.459736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.459736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.459736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.459736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.459736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.459736] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a31e087-425b-44ea-b9ec-9e51ea0cc7e7 already deleted. [ 851.460219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a31e087-425b-44ea-b9ec-9e51ea0cc7e7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.507993] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 781561fb-bac5-4326-981f-498051ee7235: rpc.has_security_group_logging(os_id): False [ 851.539611] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.539889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.539889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.540219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.540353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.540620] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.540747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.540824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.541009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.541128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.541368] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.541491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.541575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.541781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.541899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.542198] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.542322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.542402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.542562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.542648] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.542747] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781561fb-bac5-4326-981f-498051ee7235 is going to be created. [ 851.567020] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 851.567259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.619088] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.619434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.619434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.619710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.620027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.635403] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781561fb-bac5-4326-981f-498051ee7235 in Status: IN_PROGRESS for 2s [ 852.067026] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 852.067026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.208099] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-d5686ccf-d8e5-4066-8e27-d805bf7269e4 service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 852.208356] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-d5686ccf-d8e5-4066-8e27-d805bf7269e4 service nova] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 852.208562] env[65788]: INFO networking_nsxv3.common.synchronization [req-5f35a412-cfbb-4d98-b37d-bdcc102457ae req-d5686ccf-d8e5-4066-8e27-d805bf7269e4 service nova] Enqueued Resource ID: c3ae737b-6a00-4c64-8915-acf95b74f8f4 with Priority: HIGHEST for action port [ 852.210410] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_rules [ 852.210602] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 852.210743] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3ae737b-6a00-4c64-8915-acf95b74f8f4 with Priority: HIGHEST for action port [ 852.214171] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.214171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.214171] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.214171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.214171] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3ae737b-6a00-4c64-8915-acf95b74f8f4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.214171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.214171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.214171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.214171] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3ae737b-6a00-4c64-8915-acf95b74f8f4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.387303] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f1103fcb-6561-4fd7-bab2-6f9de3e7a32e tempest-ServersTestJSON-302710182 tempest-ServersTestJSON-302710182-project-member] Enqueued Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_rules [ 852.387949] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_rules [ 852.388321] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.388461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.388590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.388967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.396964] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.519885] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7c1496a1-5b10-4985-af6f-c616a79227f2 tempest-ServersTestJSON-302710182 tempest-ServersTestJSON-302710182-project-member] Enqueued Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_rules [ 852.519885] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_rules [ 852.520621] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.521025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.718399] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3ae737b-6a00-4c64-8915-acf95b74f8f4 with status ACTIVE [ 852.718399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.718399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.718399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.718399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.718399] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3ae737b-6a00-4c64-8915-acf95b74f8f4 is going to be updated. [ 852.754255] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.754255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.754255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.754665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.754800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.755011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3ae737b-6a00-4c64-8915-acf95b74f8f4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.933033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.933033] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c already deleted. [ 852.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.933033] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.067990] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 853.068300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.068470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.068990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.069274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.069556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.069647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.069904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.070027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.070174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.070366] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.071385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.071811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.071811] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.071927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.072115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.072585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.072585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.072585] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.454347] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.454531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.454594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.454760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.454871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.454925] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c already deleted. [ 853.455152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.574588] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.574891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.574997] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.596130] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7e22f57c-58ba-47d0-af35-6a07ff213683 None None] Enqueued Resource ID: 1849b221-3fc6-4549-bc6d-dea392d11970 with Priority: HIGHEST for action port [ 853.598227] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1849b221-3fc6-4549-bc6d-dea392d11970 with Priority: HIGHEST for action port [ 853.599231] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1849b221-3fc6-4549-bc6d-dea392d11970 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.599231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1849b221-3fc6-4549-bc6d-dea392d11970" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.599231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1849b221-3fc6-4549-bc6d-dea392d11970" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.599500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1849b221-3fc6-4549-bc6d-dea392d11970" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.599500] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1849b221-3fc6-4549-bc6d-dea392d11970',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.648251] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781561fb-bac5-4326-981f-498051ee7235 in Status: SUCCESS [ 853.648659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.077607] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.104267] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1849b221-3fc6-4549-bc6d-dea392d11970 [ 854.104267] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.104267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.104267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.104267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.104267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.104267] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1849b221-3fc6-4549-bc6d-dea392d11970 already deleted. [ 854.104267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1849b221-3fc6-4549-bc6d-dea392d11970" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.581170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.581530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.581530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.581627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.581819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.582037] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 854.627136] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.627631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.627787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.627929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.628150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.640304] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 854.707524] env[65788]: INFO networking_nsxv3.common.synchronization [req-3ff4aa51-5788-4316-bac1-76638be13be7 req-1e2ea457-e8a4-4c03-9d31-1f0a46924645 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 854.707845] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 854.708187] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.708317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.708388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.708575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.709196] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.709914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.709914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.709914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.709914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.709914] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.726705] env[65788]: INFO networking_nsxv3.common.synchronization [req-3ff4aa51-5788-4316-bac1-76638be13be7 req-1e2ea457-e8a4-4c03-9d31-1f0a46924645 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 854.726779] env[65788]: INFO networking_nsxv3.common.synchronization [req-3ff4aa51-5788-4316-bac1-76638be13be7 req-1e2ea457-e8a4-4c03-9d31-1f0a46924645 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 854.726911] env[65788]: INFO networking_nsxv3.common.synchronization [req-3ff4aa51-5788-4316-bac1-76638be13be7 req-1e2ea457-e8a4-4c03-9d31-1f0a46924645 tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 979de45a-6514-49fc-be68-6f53402f7f77 with Priority: HIGHEST for action port [ 854.727443] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_rules [ 854.728894] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 854.728894] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979de45a-6514-49fc-be68-6f53402f7f77 with Priority: HIGHEST for action port [ 854.728894] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.728894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.728894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.728894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.728894] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.729804] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.729909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.730134] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-979de45a-6514-49fc-be68-6f53402f7f77 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.730364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.730459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.732335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.732425] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979de45a-6514-49fc-be68-6f53402f7f77',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.212180] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.234710] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 979de45a-6514-49fc-be68-6f53402f7f77 with status ACTIVE [ 855.235033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.235210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.235313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.235604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.235734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.235976] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.236137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.236232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.236449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.236556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.236785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.236879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.236948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.237119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.237195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.237280] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 979de45a-6514-49fc-be68-6f53402f7f77 is going to be updated. [ 855.239055] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.239055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.260977] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.260977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.261236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.261325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.261649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.261896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979de45a-6514-49fc-be68-6f53402f7f77" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.714796] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.218217] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.218371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.219201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.220328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.220468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.220613] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be updated. [ 856.257303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.257303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.257303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.257303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.257303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.266040] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 856.421523] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7ab92bbe-4d2e-49bb-9ae8-284b37056ef4 None None] Enqueued Resource ID: 7d02b678-c29b-48ca-b585-0c9279ec92ae with Priority: HIGHEST for action port [ 856.422145] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d02b678-c29b-48ca-b585-0c9279ec92ae with Priority: HIGHEST for action port [ 856.422574] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d02b678-c29b-48ca-b585-0c9279ec92ae taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.422713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d02b678-c29b-48ca-b585-0c9279ec92ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.422763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d02b678-c29b-48ca-b585-0c9279ec92ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.423084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d02b678-c29b-48ca-b585-0c9279ec92ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.423374] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d02b678-c29b-48ca-b585-0c9279ec92ae',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.654054] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 4s [ 856.926037] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d02b678-c29b-48ca-b585-0c9279ec92ae [ 856.926037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.926752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.926752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.926752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.926752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.926898] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d02b678-c29b-48ca-b585-0c9279ec92ae already deleted. [ 856.926898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d02b678-c29b-48ca-b585-0c9279ec92ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.459172] env[65788]: INFO networking_nsxv3.common.synchronization [req-66ef9ef1-3cdb-4216-9d05-29d0b7b57985 req-dd7e025a-55a4-439d-b685-505ef211a425 tempest-ServersWithSpecificFlavorTestJSON-1851839051 tempest-ServersWithSpecificFlavorTestJSON-1851839051-project-member] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 857.459172] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 857.459172] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.459172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.459172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.459172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.459172] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.459675] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.459961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.461162] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.461360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.461575] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.970436] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.970815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.970815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.970815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.970932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.971123] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.973765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.973765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.973765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.973765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.973765] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be updated. [ 858.009367] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.009367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.009367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.009367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.009367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.018796] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: IN_PROGRESS for 2s [ 858.093061] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.093061] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.093061] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.093446] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.093760] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.093986] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.096508] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.097795] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.097795] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.097879] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.097954] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.098087] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.102045] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.102045] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.102045] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.102045] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.124980] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.125309] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.125497] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.125737] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-774" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.126231] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-a252ce1e-e74a-4000-bca8-f82098f352da taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.126231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.126370] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.126743] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.126903] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a252ce1e-e74a-4000-bca8-f82098f352da',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.278291] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 858.278530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.278676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.279054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.280841] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.281029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.281117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.281305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.281397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.281522] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.631559] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.631559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.631559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.631559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.631559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.631559] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port a252ce1e-e74a-4000-bca8-f82098f352da not found, creating... [ 858.631559] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.631559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.631559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.631559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.632345] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.632345] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.632582] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.632797] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.633065] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.633305] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.633541] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: a252ce1e-e74a-4000-bca8-f82098f352da is going to be created. [ 858.667400] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 858.667736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.668013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.668342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.668622] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.669262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.669262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.669262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.669477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.669514] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.675683] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.675683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.675683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.676083] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.676083] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.676254] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.784356] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.172558] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.288699] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.349794] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ce5fe546-3064-49b2-8b6b-f46ad45b3abf None None] Enqueued Resource ID: 3e6a846d-5381-4895-afb4-2a72bacc5439 with Priority: HIGHEST for action port [ 859.350062] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e6a846d-5381-4895-afb4-2a72bacc5439 with Priority: HIGHEST for action port [ 859.350286] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e6a846d-5381-4895-afb4-2a72bacc5439 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.350398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e6a846d-5381-4895-afb4-2a72bacc5439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.350467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e6a846d-5381-4895-afb4-2a72bacc5439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.350719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e6a846d-5381-4895-afb4-2a72bacc5439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.350803] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6a846d-5381-4895-afb4-2a72bacc5439',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.380340] env[65788]: INFO networking_nsxv3.common.synchronization [req-66ef9ef1-3cdb-4216-9d05-29d0b7b57985 req-318239a1-0a58-424b-851f-017c5f6c0d64 service nova] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 859.380340] env[65788]: INFO networking_nsxv3.common.synchronization [req-66ef9ef1-3cdb-4216-9d05-29d0b7b57985 req-318239a1-0a58-424b-851f-017c5f6c0d64 service nova] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 859.380340] env[65788]: INFO networking_nsxv3.common.synchronization [req-66ef9ef1-3cdb-4216-9d05-29d0b7b57985 req-318239a1-0a58-424b-851f-017c5f6c0d64 service nova] Enqueued Resource ID: a252ce1e-e74a-4000-bca8-f82098f352da with Priority: HIGHEST for action port [ 859.381090] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_rules [ 859.381090] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 859.381090] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a252ce1e-e74a-4000-bca8-f82098f352da with Priority: HIGHEST for action port [ 859.381090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.382293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.382293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.382293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.382293] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.383363] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.383529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.383983] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a252ce1e-e74a-4000-bca8-f82098f352da taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.383983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.383983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.384992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.384992] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a252ce1e-e74a-4000-bca8-f82098f352da',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.676245] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.794102] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.794361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.796128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.796302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.796450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.796551] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be updated. [ 859.849677] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.849677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.849677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.849677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.849677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.853861] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e6a846d-5381-4895-afb4-2a72bacc5439 [ 859.853861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.853861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.853861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.853861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.853861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.853861] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e6a846d-5381-4895-afb4-2a72bacc5439 already deleted. [ 859.853861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e6a846d-5381-4895-afb4-2a72bacc5439" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.858220] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 859.886538] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.886695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.886917] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a252ce1e-e74a-4000-bca8-f82098f352da with status ACTIVE [ 859.887192] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.887320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.887390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.887659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.887793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.888098] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.888275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.888275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.888505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.889779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.890182] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.890360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.890360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.890530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.890617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.890733] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a252ce1e-e74a-4000-bca8-f82098f352da is going to be updated. [ 859.929099] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.929402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.929402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.929680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.929680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.929812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a252ce1e-e74a-4000-bca8-f82098f352da" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.964517] env[65788]: INFO networking_nsxv3.common.synchronization [req-19f82065-0290-4ad4-a6db-55c20a633571 req-a606da97-4a1c-4d22-9214-9bbf50a80729 tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 859.965052] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 859.965281] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.965510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.965510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.965704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.966086] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.966086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.966086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.966445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.966445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.966523] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.033885] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 860.034323] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 deletion is rescheduled due to dependency. [ 860.034323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.034782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.035026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.035204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.035394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.035394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.035554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.035645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.035734] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.179472] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.180052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.180052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.180052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.180271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.180338] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 860.220811] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.221125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.221125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.221393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.221524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.236852] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 860.469591] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.469797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.469851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.470086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.496094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.497081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.497288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.497363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.497577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.497712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.497815] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be updated. [ 860.531941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.532167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.532167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.534137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.534137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.538761] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.544389] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: IN_PROGRESS for 2s [ 861.042856] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.108152] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b7b70836-a2eb-4db4-ab58-ee423cbf265c tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_rules [ 861.108746] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_rules [ 861.109213] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.109363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.109455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.109854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.110069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.346955] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f2460ee7-2992-4859-8f13-a7a7f98b7a30 tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_rules [ 861.346955] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_rules [ 861.347372] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.347372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.544144] env[65788]: INFO networking_nsxv3.common.synchronization [None req-0126cbaa-db3a-4337-9a22-d21d1ad28412 None None] Enqueued Resource ID: 82a20f38-2e02-4d98-b9c2-3f3dc015908d with Priority: HIGHEST for action port [ 861.544705] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82a20f38-2e02-4d98-b9c2-3f3dc015908d with Priority: HIGHEST for action port [ 861.547102] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.547324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.548818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.549840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.549840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.549840] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be updated. [ 861.552170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-82a20f38-2e02-4d98-b9c2-3f3dc015908d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.552316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82a20f38-2e02-4d98-b9c2-3f3dc015908d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.552413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82a20f38-2e02-4d98-b9c2-3f3dc015908d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.552634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82a20f38-2e02-4d98-b9c2-3f3dc015908d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.552715] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a20f38-2e02-4d98-b9c2-3f3dc015908d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.588790] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.589056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.589349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.589492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.589557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.599897] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: IN_PROGRESS for 2s [ 861.650029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.650029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.650029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.650372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.650372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.650439] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 already deleted. [ 861.650503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.650660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.651010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.651010] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.871044] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.871044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.871044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.871044] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.061086] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82a20f38-2e02-4d98-b9c2-3f3dc015908d [ 862.061086] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.061086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.061086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.061086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.061086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.061086] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82a20f38-2e02-4d98-b9c2-3f3dc015908d already deleted. [ 862.061086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82a20f38-2e02-4d98-b9c2-3f3dc015908d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.176809] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.177074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.177074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.177283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.177372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.177466] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 already deleted. [ 862.177565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.247438] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 862.247663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.247844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.248087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.248284] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.248586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.248586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.248671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.248671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.248792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.249105] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.249105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.249105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.249272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.249333] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.249424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.249483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.249621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.249682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.249766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.249854] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.353792] env[65788]: INFO networking_nsxv3.common.synchronization [req-a6cb00ca-c3f9-4170-9b2e-93d1a9f43b9c req-6e3bd65c-eee2-45af-9a7e-33e99a3fb951 tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 862.355493] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 862.358019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.358019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.358019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.358019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.358019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.358019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.358019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.358019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.358019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.358019] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.373874] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.556727] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: SUCCESS [ 862.556926] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c deletion is rescheduled due to dependency. [ 862.557051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.753605] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44: rpc.has_security_group_logging(os_id): False [ 862.776125] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.776125] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.776125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.776125] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.779871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.779871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.779871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.779871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.779871] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.779871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.779871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.780286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.781431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.781431] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be created. [ 862.791713] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.792050] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.792200] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.792857] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.793828] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.794559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.795046] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.795310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.795692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.795972] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.796133] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.796409] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.796559] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.796683] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.796799] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.797253] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.821856] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.822216] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.822386] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.822618] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.823185] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-ceb0021e-23a6-4f1a-be65-d662ed9239db taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.823376] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.823507] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.824680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.825734] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceb0021e-23a6-4f1a-be65-d662ed9239db',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.860092] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.864462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.864462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.864462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.864462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.864462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.878356] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 478cab84-cb72-4b89-ac1a-ce3970d7f356: rpc.has_security_group_logging(os_id): False [ 862.883358] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 862.904855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.905050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.905127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.905414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.905531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.905876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.906070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.906139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.906380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.906523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.906642] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be updated. [ 863.027037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.027305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.027388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.027777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.028033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.055058] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 863.328650] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.328919] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.329147] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.329469] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.329748] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.330737] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port ceb0021e-23a6-4f1a-be65-d662ed9239db not found, creating... [ 863.330737] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.330737] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.330936] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.331141] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.331320] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.331858] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.332139] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.332276] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.332521] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.332652] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.332872] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: ceb0021e-23a6-4f1a-be65-d662ed9239db is going to be created. [ 863.359842] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.360292] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.360292] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.360669] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.360878] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.361579] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.366380] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.612051] env[65788]: INFO networking_nsxv3.common.synchronization [req-a58b42e0-bd55-48e0-84b4-1aed6c679263 req-4abc3666-1140-4e47-8769-58942060a81d tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 863.613332] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 863.614310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.614746] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 863.614895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.615124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.615366] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.615548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.615641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.615879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.616020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.616107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.616214] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.617370] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.617591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.618061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.618061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.618246] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.618349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.618453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.618655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.619531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.619531] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.871557] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.871557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.871557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.871557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.871557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.871557] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 863.908498] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.908638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.908638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.908906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.908995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.920701] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 863.966296] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b5c3dd53-25fc-4464-93e4-60b2a0338001 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 863.968870] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 863.968870] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.968870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.968870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.968870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.968870] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.122021] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.123214] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.169958] env[65788]: INFO networking_nsxv3.common.synchronization [None req-1476b939-ab97-4dc3-b679-8a2f3c917da8 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 864.169958] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 864.170212] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.170363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.197868] env[65788]: INFO networking_nsxv3.common.synchronization [req-a6cb00ca-c3f9-4170-9b2e-93d1a9f43b9c req-697bd1c1-e9ff-4e01-bb90-b48e76f6c985 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 864.198024] env[65788]: INFO networking_nsxv3.common.synchronization [req-a6cb00ca-c3f9-4170-9b2e-93d1a9f43b9c req-697bd1c1-e9ff-4e01-bb90-b48e76f6c985 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 864.198174] env[65788]: INFO networking_nsxv3.common.synchronization [req-a6cb00ca-c3f9-4170-9b2e-93d1a9f43b9c req-697bd1c1-e9ff-4e01-bb90-b48e76f6c985 service nova] Enqueued Resource ID: ceb0021e-23a6-4f1a-be65-d662ed9239db with Priority: HIGHEST for action port [ 864.198663] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 864.198663] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 864.198791] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb0021e-23a6-4f1a-be65-d662ed9239db with Priority: HIGHEST for action port [ 864.199682] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.199902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.199902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.200804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.200804] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.201816] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.202903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.203823] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ceb0021e-23a6-4f1a-be65-d662ed9239db taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.204074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.204074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.205166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.205166] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceb0021e-23a6-4f1a-be65-d662ed9239db',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.495361] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.495785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.495785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.496760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.496760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.496760] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d already deleted. [ 864.497183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.497491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.497787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.497900] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.629132] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 657a43cf-f5af-40a8-8da7-615eb6b41a78: rpc.has_security_group_logging(os_id): False [ 864.630514] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.636681] env[65788]: INFO networking_nsxv3.common.synchronization [None req-f678c76a-4806-4ebb-b6a2-c5cdf33314ef None None] Enqueued Resource ID: 3b2dccd6-bf60-405a-b253-3ea5204ac0f8 with Priority: HIGHEST for action port [ 864.637217] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b2dccd6-bf60-405a-b253-3ea5204ac0f8 with Priority: HIGHEST for action port [ 864.637571] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b2dccd6-bf60-405a-b253-3ea5204ac0f8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.637693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b2dccd6-bf60-405a-b253-3ea5204ac0f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.637758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b2dccd6-bf60-405a-b253-3ea5204ac0f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.639704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b2dccd6-bf60-405a-b253-3ea5204ac0f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.639704] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b2dccd6-bf60-405a-b253-3ea5204ac0f8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.657246] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.661024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.661024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.661024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.661024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.661758] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.662039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.662161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.662392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.662484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.662588] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be updated. [ 864.706638] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.707892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.708291] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ceb0021e-23a6-4f1a-be65-d662ed9239db with status ACTIVE [ 864.708520] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.708652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.708718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.708957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.709065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.709257] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.709364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.709428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.709603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.709699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.710560] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.710560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.710560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.710560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.710560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.710807] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ceb0021e-23a6-4f1a-be65-d662ed9239db is going to be updated. [ 864.744202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.744518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.744620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.745074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.745074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.745274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ceb0021e-23a6-4f1a-be65-d662ed9239db" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.751855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.752152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.752152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.752386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.752549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.779878] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: IN_PROGRESS for 2s [ 864.905458] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 864.905739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.905881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.906126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.906683] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.024338] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.024524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.024847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.025153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.025277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.025392] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d already deleted. [ 865.025485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.070689] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 865.070689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.135732] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.135732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.135732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.136017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.136017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.136104] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 865.142071] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b2dccd6-bf60-405a-b253-3ea5204ac0f8 [ 865.142290] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.142290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.142412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.143103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.143103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.143103] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b2dccd6-bf60-405a-b253-3ea5204ac0f8 already deleted. [ 865.143103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b2dccd6-bf60-405a-b253-3ea5204ac0f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.169864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.170080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.170210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.170386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.170531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.183490] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 865.409029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.409254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.409254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.409564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.409817] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.409986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.410085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.410242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.410335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.410436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.410610] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.914659] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.915187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.915187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.915187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.915383] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.915483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.915543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.915690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.915770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.915859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.916021] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.916228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.916228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.916326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.916443] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.916611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.916679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.916811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.916890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.916973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.917079] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.930702] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 865.930919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.931598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.931925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.931925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.931925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.932143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.932444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.932444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.932444] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.203528] env[65788]: INFO networking_nsxv3.common.synchronization [req-d79259b0-44de-41e2-8b1d-edb1deb08941 req-2d80a7d5-bc89-4d6e-866c-b25495f31dec tempest-AttachInterfacesUnderV243Test-1572155932 tempest-AttachInterfacesUnderV243Test-1572155932-project-member] Enqueued Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 866.204138] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 with Priority: HIGHEST for action security_group_members [ 866.204576] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-478cab84-cb72-4b89-ac1a-ce3970d7f356 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.204809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.204944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.205959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.206163] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.206311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.206382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.206540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.206637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.206725] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('478cab84-cb72-4b89-ac1a-ce3970d7f356',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.421120] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44: rpc.has_security_group_logging(os_id): False [ 866.435256] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.442273] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.442492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.442573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.442839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.443145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.443228] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.443361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.443434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.445097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.445097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.445097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.445710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.445710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.445710] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 866.527482] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.527672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.527774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.528185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.528799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.550871] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 866.709613] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.709754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.709828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.710074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.710207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.710403] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.710517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.710583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.710843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.710843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.710934] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 is going to be updated. [ 866.748226] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.748314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.748355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.748552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.748699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.759370] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: IN_PROGRESS for 2s [ 866.797472] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 866.797701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.938237] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.196248] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 867.196248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.440844] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.441286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.441286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.441439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.441439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.441516] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 867.478233] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.478386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.480694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.480694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.480694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.490742] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 867.916919] env[65788]: INFO networking_nsxv3.common.synchronization [req-6ae71068-d39e-4d59-98c3-c1a8e95d39e0 req-ca80bc49-67cd-4884-9098-cd563da14b70 tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 867.916919] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 867.916919] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.916919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.916919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.916919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.916919] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.916919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.916919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.916919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.916919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.916919] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.420025] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.600041] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 868.601138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.672932] env[65788]: INFO networking_nsxv3.common.synchronization [req-93c893bc-1772-4452-b8ae-3b6ab4d3ec58 req-29d8cc95-fa12-4fe7-9e09-f3d1c2446501 tempest-MultipleCreateTestJSON-2114692520 tempest-MultipleCreateTestJSON-2114692520-project-member] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 868.674426] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGHEST for action security_group_members [ 868.675300] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.675300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.773034] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 in Status: SUCCESS [ 868.773034] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 478cab84-cb72-4b89-ac1a-ce3970d7f356 deletion is rescheduled due to dependency. [ 868.773034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-478cab84-cb72-4b89-ac1a-ce3970d7f356" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.921794] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.424510] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.427474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.427474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.427474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.427474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.427474] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 869.462596] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.462831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.463043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.463372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.463576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.475340] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 869.500171] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 869.500425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.500796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.500880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.501035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.501157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.501227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.501479] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.501562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.501650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.501746] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.007075] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.007257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.007335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.007560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.007732] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.007834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.007900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.008332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.008332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.008332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.008469] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.008530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.008570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.008687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.008835] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.008937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.009054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.009158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.009255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.009318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.009413] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.515965] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482328ee-c8ae-447e-af1f-c321cd088282: rpc.has_security_group_logging(os_id): False [ 870.546364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.546364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.546364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.546364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.572101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.572329] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.572454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.574141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.574141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.574141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.574141] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.574141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.574141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.574141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.574141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.574141] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.574611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.574611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.574611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.574611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.574611] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 870.655466] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.655720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.655720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.656996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.656996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.679174] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 871.489075] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 871.489075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.489075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.489075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.489075] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.489075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.489075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.489075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.489075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.489075] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.994265] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.994265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.994586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.994775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.994775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.995270] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.995270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.995270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.995270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.995777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.995777] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be updated. [ 872.027253] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.028793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.028793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.028793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.028793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.039536] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: IN_PROGRESS for 2s [ 872.697177] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 872.697177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.228770] env[65788]: INFO networking_nsxv3.common.synchronization [req-c93d8649-9d56-4e14-a5a5-3d7faa6d143e req-d9faccef-efb9-425d-88e1-ea3fe743d0b7 tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 873.229675] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 873.229952] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.229952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.230077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.230329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.230586] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.230690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.230789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.230979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.231113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.231242] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.319438] env[65788]: INFO networking_nsxv3.common.synchronization [req-009f1999-4eaf-4159-96f3-30f2f44cadca req-ff0d1ed0-cd3f-410f-8e15-96cbdb8375ab tempest-ServersAdminTestJSON-626341121 tempest-ServersAdminTestJSON-626341121-project-member] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 873.319999] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGHEST for action security_group_members [ 873.320382] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.320481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.320576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.320755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.320912] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.324737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.324737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.324737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.324737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.324737] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.706631] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.706895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.706998] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.707369] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.707585] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.707744] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.707904] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.708303] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.708303] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.708963] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.709318] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.709453] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.709611] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.709899] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.710094] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.712056] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.734691] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.734971] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.735312] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.735493] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.736195] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-6be7224d-2e38-4db2-b952-9ab700581f68 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.736382] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.736689] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.737409] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.737713] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be7224d-2e38-4db2-b952-9ab700581f68',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.738984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.739121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.739463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.739463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.739463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.739633] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.739723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.739805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.740645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.740645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.740645] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be deleted. [ 873.783550] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.783711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.786230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.786230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.786230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.786230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.826178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.826351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.827318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.827318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.851708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.853940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.854131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.854204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.854514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.854612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.854724] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be updated. [ 873.889821] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.890276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.890374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.890613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.890697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.903211] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: IN_PROGRESS for 2s [ 874.056575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 in Status: SUCCESS [ 874.056789] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 deletion is rescheduled due to dependency. [ 874.056912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.242864] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.243317] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.243317] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.243703] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.243927] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.244193] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 6be7224d-2e38-4db2-b952-9ab700581f68 not found, creating... [ 874.244582] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.244818] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.244996] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.245367] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.245588] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.246052] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.246274] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.246419] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.246697] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.246859] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.247049] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 6be7224d-2e38-4db2-b952-9ab700581f68 is going to be created. [ 874.270701] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.270826] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.270923] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.271254] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.271581] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.271853] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.070114] env[65788]: INFO networking_nsxv3.common.synchronization [req-c93d8649-9d56-4e14-a5a5-3d7faa6d143e req-3231cd34-5b1f-4eef-8628-f92db08afe14 service nova] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_rules [ 875.070327] env[65788]: INFO networking_nsxv3.common.synchronization [req-c93d8649-9d56-4e14-a5a5-3d7faa6d143e req-3231cd34-5b1f-4eef-8628-f92db08afe14 service nova] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 875.070734] env[65788]: INFO networking_nsxv3.common.synchronization [req-c93d8649-9d56-4e14-a5a5-3d7faa6d143e req-3231cd34-5b1f-4eef-8628-f92db08afe14 service nova] Enqueued Resource ID: 6be7224d-2e38-4db2-b952-9ab700581f68 with Priority: HIGHEST for action port [ 875.072378] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_rules [ 875.072378] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 875.072378] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be7224d-2e38-4db2-b952-9ab700581f68 with Priority: HIGHEST for action port [ 875.072578] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.072713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.072713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.073415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.073415] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.074316] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.074522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.074612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.074932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.074976] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.075114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.075215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.075407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.075499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.075597] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.077154] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-6be7224d-2e38-4db2-b952-9ab700581f68 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.077154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.077154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.077154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.077154] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be7224d-2e38-4db2-b952-9ab700581f68',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.505762] env[65788]: INFO networking_nsxv3.common.synchronization [req-9f08a523-9c11-4dc3-9f08-9aa755416449 req-5c023622-ddf0-4248-9ef9-4257c4d726b8 tempest-ServerMetadataNegativeTestJSON-1690454738 tempest-ServerMetadataNegativeTestJSON-1690454738-project-member] Enqueued Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_members [ 875.506726] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGHEST for action security_group_members [ 875.506726] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.506907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.506907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.510959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.511213] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.511341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.511411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.511602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.511690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.511789] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.579414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.579971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.580290] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.581406] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6be7224d-2e38-4db2-b952-9ab700581f68 with status ACTIVE [ 875.582088] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.582088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.582088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.582088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.582088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.582495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.582495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.582495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.582744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.582744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.584690] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.584690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.584690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.584690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.584690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.584690] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6be7224d-2e38-4db2-b952-9ab700581f68 is going to be updated. [ 875.605933] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.607514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.607514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.608330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.608330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.608330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6be7224d-2e38-4db2-b952-9ab700581f68" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.913810] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e in Status: SUCCESS [ 875.913985] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e deletion is rescheduled due to dependency. [ 875.914164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.014999] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.015177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.015282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.015526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.016050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.016050] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.016050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.016050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.016236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.016272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.016340] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781561fb-bac5-4326-981f-498051ee7235 is going to be updated. [ 876.046815] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.047045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.047130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.047381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.047543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.060061] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781561fb-bac5-4326-981f-498051ee7235 in Status: IN_PROGRESS for 2s [ 876.085700] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.590453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.590846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.590846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.590923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.590994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.591109] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be created. [ 876.617256] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.617256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.617256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.617256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.617256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.630072] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: UNINITIALIZED for 2s [ 878.073381] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781561fb-bac5-4326-981f-498051ee7235 in Status: SUCCESS [ 878.073675] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781561fb-bac5-4326-981f-498051ee7235 deletion is rescheduled due to dependency. [ 878.073869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.643980] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 878.644335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.644577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.644815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.645033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.645195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.645263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.645434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.645940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.645940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.645940] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.149181] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.149518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.149518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.150151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.150221] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.150413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.150534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.150747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.150890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.151054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.151312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.151500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.151625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.151839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.152194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.152442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.152587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.152811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.152965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.153136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.153305] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.656115] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 312ecf31-d6a5-4636-8de5-71be8f37e76e: rpc.has_security_group_logging(os_id): False [ 879.662558] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2ab229-b2a2-46ee-a493-6d0c9773acce req-d6f8a843-455d-4ef1-9ced-d9f29079e829 tempest-ServersTestFqdnHostnames-1416237530 tempest-ServersTestFqdnHostnames-1416237530-project-member] Enqueued Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_members [ 879.663127] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_members [ 879.663446] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.663576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.663665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.665997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.666914] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.667065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.667139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.667323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.667410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.667510] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.678855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.678998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.679083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.679287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.679375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.679582] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.679681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.679742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.679888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.679965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.680164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.680252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.680310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.680447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.680520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.680760] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.680861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.680922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.681582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.681582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.681582] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be created. [ 879.739961] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.740119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.740186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.740395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.740590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.755611] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 879.996738] env[65788]: INFO networking_nsxv3.common.synchronization [req-7ed1a6f2-3d01-480c-a5d2-3f1d4132475f req-49e8d120-016f-4ff2-8f35-7b341e7f2364 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 879.997551] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 879.997957] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.999027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.999027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.999027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.999027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.999027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.999027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.999027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.999276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.999361] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.149564] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.149823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-558" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.149823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-558" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.150713] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-558" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.150713] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.150895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.151024] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.151257] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.151397] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.151605] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.151714] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.151827] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.151930] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.153134] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.153134] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.153134] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.171054] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.171054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.173552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.173808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.173903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.174164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.174284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.174350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.174521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.174608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.174702] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 already deleted. [ 880.174785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.175840] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.175987] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.176791] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.176970] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-558" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.177304] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.177433] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.177551] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.178505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.179123] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.503414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.503744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.503934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.504250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.504405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.504660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.504790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.504865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.505066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.505176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.505293] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 880.534255] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.534255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.534440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.534690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.534833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.544676] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 880.684890] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.685224] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.685546] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.685871] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.686072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.686289] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 not found, creating... [ 880.686614] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.686816] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.686961] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.687222] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.687396] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.687722] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.687928] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.688095] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.688342] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.688507] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.688682] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 is going to be created. [ 880.716130] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.716535] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.716780] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.717212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.717554] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.717820] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.278023] env[65788]: INFO networking_nsxv3.common.synchronization [req-a3f917e1-9a60-4d29-a30a-f58fed0cf443 req-f7247582-226f-4725-be3a-bacf0632b9f4 tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 881.279473] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 881.279473] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.279650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.279812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.280209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.280503] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.280775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.282198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.282198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.282198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.282198] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.466142] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2ab229-b2a2-46ee-a493-6d0c9773acce req-79a4db75-11aa-47fb-8e9c-1eb1e461de01 service nova] Enqueued Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_rules [ 881.466864] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2ab229-b2a2-46ee-a493-6d0c9773acce req-79a4db75-11aa-47fb-8e9c-1eb1e461de01 service nova] Enqueued Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_members [ 881.469774] env[65788]: INFO networking_nsxv3.common.synchronization [req-ff2ab229-b2a2-46ee-a493-6d0c9773acce req-79a4db75-11aa-47fb-8e9c-1eb1e461de01 service nova] Enqueued Resource ID: c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 with Priority: HIGHEST for action port [ 881.469774] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_rules [ 881.469774] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_members [ 881.469774] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 with Priority: HIGHEST for action port [ 881.469774] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.469774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.469774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.469774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.469774] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.471567] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.471827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.471871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.472175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.473028] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.473028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.473028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.473028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.473028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.473028] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.475340] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.475340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.475340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.475340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.475340] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.770554] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 881.770839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.784664] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.978025] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.979670] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.979776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.980730] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 with status ACTIVE [ 881.980730] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.980730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.980730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.980994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.981108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.981304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.981402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.981720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.981814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.981897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.982093] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.982622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.982692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.982845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.982975] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.983081] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7 is going to be updated. [ 882.010535] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.010535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.010691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.010819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.010969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.011154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3070dd4-4e71-49db-ac95-dbb3f9a1f5d7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.286679] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.322090] env[65788]: INFO networking_nsxv3.common.synchronization [req-ada2f484-1ce9-4767-a40b-078b9b143023 req-3e33aeb7-8a4e-4144-aa91-92a9ce29af48 tempest-InstanceActionsNegativeTestJSON-1995453059 tempest-InstanceActionsNegativeTestJSON-1995453059-project-member] Enqueued Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_members [ 882.322703] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_members [ 882.323226] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.323500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.323500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.323845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.324131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.324537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.324537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.324616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.324665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.324770] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.487013] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.555908] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 882.555908] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 882.556061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.669165] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-150 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.669502] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-150" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.669760] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-150" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.670266] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-150" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.670647] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.670861] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.670990] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.671246] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.671389] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.671609] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.671713] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.671836] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.671925] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.672042] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.672193] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.672309] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.693062] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.693283] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.693426] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.693733] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-150" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.694290] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.694532] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.694687] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.695133] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.695386] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.789089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.791580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.791580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.791580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.791580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.791580] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 882.822950] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.822950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.822950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.822950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.822950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.826695] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.826858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.826926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.827137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.827241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.827438] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.827537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.827611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.827767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.827845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.827929] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 already deleted. [ 882.828018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.832057] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 882.993027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.993027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.993027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.993027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.993027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.993027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 is going to be created. [ 883.016417] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.019895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.019895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.019895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.019895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.031579] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 793b8c66-424d-4744-801e-0d08e132ad00 in Status: UNINITIALIZED for 2s [ 883.198017] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.198769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.198769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.198769] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.198917] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.199014] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b not found, creating... [ 883.199299] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.199469] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.199585] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.199814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.199950] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.200277] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.200435] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.200553] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.200831] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.200894] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.201047] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b is going to be created. [ 883.222268] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.222579] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.222658] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.222921] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.223309] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.223582] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.014686] env[65788]: INFO networking_nsxv3.common.synchronization [req-ada2f484-1ce9-4767-a40b-078b9b143023 req-6fa6b616-1fc3-4d96-ba85-8b6a0587c668 service nova] Enqueued Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_rules [ 884.014686] env[65788]: INFO networking_nsxv3.common.synchronization [req-ada2f484-1ce9-4767-a40b-078b9b143023 req-6fa6b616-1fc3-4d96-ba85-8b6a0587c668 service nova] Enqueued Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_members [ 884.014686] env[65788]: INFO networking_nsxv3.common.synchronization [req-ada2f484-1ce9-4767-a40b-078b9b143023 req-6fa6b616-1fc3-4d96-ba85-8b6a0587c668 service nova] Enqueued Resource ID: c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b with Priority: HIGHEST for action port [ 884.015017] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_rules [ 884.015114] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_members [ 884.015232] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b with Priority: HIGHEST for action port [ 884.015552] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.015681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.015750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.016069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.016149] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.017363] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.017363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.017465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.017670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.017757] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.017857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.018068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.018068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.018169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.018274] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.021533] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.021533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.021533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.021533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.021533] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.523831] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.523982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.524175] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.525110] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b with status ACTIVE [ 884.525309] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.525426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.525493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.525723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.525792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.525959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.526623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.526762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.526900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.526986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.527196] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.527252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.527324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.527446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.527524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.528221] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b is going to be updated. [ 884.552267] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.552267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.552267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.552267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.552267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.552267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c496bd9f-4c5d-4e4e-8bb6-daf2d6f7a09b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.849056] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 884.849326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.030200] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.046434] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 793b8c66-424d-4744-801e-0d08e132ad00 in Status: SUCCESS [ 885.047683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.047683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.047683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.047683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.051214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.051214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.051214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.051214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.051214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.051214] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.188397] env[65788]: INFO networking_nsxv3.common.synchronization [req-f06cf6d9-9eb3-4875-a0e3-d1acb421bb9a req-4c1f1cfd-968f-4d58-9840-962b2b8c0dac tempest-ServersTestJSON-302710182 tempest-ServersTestJSON-302710182-project-member] Enqueued Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_members [ 885.189120] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_members [ 885.189817] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.189817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.189817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.191961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.191961] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.191961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.191961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.191961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.191961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.191961] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.538174] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.538379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.538457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.538655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.538703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.538776] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 is going to be created. [ 885.553657] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.572943] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.572943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.573129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.573260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.573431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.594426] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 in Status: UNINITIALIZED for 2s [ 885.603961] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.604634] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-289" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.604634] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-289" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.604925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-289" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.605189] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.605392] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.606098] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.606498] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.606717] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.606983] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.607167] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.607335] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.607499] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.607668] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.607812] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.607978] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.653559] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.653757] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.653945] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.654197] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-289" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.654609] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-a2cfa958-414d-4289-8d2b-b26d4bb848ab taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.654847] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.654994] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.655517] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.655703] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2cfa958-414d-4289-8d2b-b26d4bb848ab',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.693393] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.693622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.693655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.693870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.693963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.694215] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.694323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.694390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.694665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.694789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.694864] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c already deleted. [ 885.694954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.057225] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 793b8c66-424d-4744-801e-0d08e132ad00: rpc.has_security_group_logging(os_id): False [ 886.077267] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.077452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.077519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.077737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.077831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.078114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.078239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.078306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.078489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.078564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.078653] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 is going to be created. [ 886.155650] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.155650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.155650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.155650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.155838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.157920] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.158194] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.158403] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.158699] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.158901] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.159130] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port a2cfa958-414d-4289-8d2b-b26d4bb848ab not found, creating... [ 886.159438] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.159681] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.159831] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.160145] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.160382] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.160729] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.160937] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.161135] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.161400] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.161571] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.161796] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: a2cfa958-414d-4289-8d2b-b26d4bb848ab is going to be created. [ 886.168734] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 793b8c66-424d-4744-801e-0d08e132ad00 in Status: IN_PROGRESS for 2s [ 886.179859] env[65788]: INFO networking_nsxv3.common.synchronization [req-29c0bb0d-f6e3-4467-9be4-edbb9253e65f req-4ba5a1c3-02dc-4fdd-8f01-94c7fddd7774 tempest-ImagesOneServerNegativeTestJSON-411174624 tempest-ImagesOneServerNegativeTestJSON-411174624-project-member] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 886.180715] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGHEST for action security_group_members [ 886.181090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.181240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.181322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.181528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.181750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.181870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.182026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.182115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.182280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.182378] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.186986] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.187267] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.187507] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.187866] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.188356] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.188537] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.685504] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.685683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.685812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.686680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.686680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.686680] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.686680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.686680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.687110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.687110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.687199] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be updated. [ 886.718437] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.718615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.718687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.718963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.719129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.738577] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: IN_PROGRESS for 2s [ 886.927124] env[65788]: INFO networking_nsxv3.common.synchronization [req-f06cf6d9-9eb3-4875-a0e3-d1acb421bb9a req-a412c9b8-8d81-43e0-ba69-78071dad6248 service nova] Enqueued Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_rules [ 886.927336] env[65788]: INFO networking_nsxv3.common.synchronization [req-f06cf6d9-9eb3-4875-a0e3-d1acb421bb9a req-a412c9b8-8d81-43e0-ba69-78071dad6248 service nova] Enqueued Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_members [ 886.927716] env[65788]: INFO networking_nsxv3.common.synchronization [req-f06cf6d9-9eb3-4875-a0e3-d1acb421bb9a req-a412c9b8-8d81-43e0-ba69-78071dad6248 service nova] Enqueued Resource ID: a2cfa958-414d-4289-8d2b-b26d4bb848ab with Priority: HIGHEST for action port [ 886.928460] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_rules [ 886.928580] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_members [ 886.928681] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cfa958-414d-4289-8d2b-b26d4bb848ab with Priority: HIGHEST for action port [ 886.929019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.929166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.929254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.929839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.929931] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.931840] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.931840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.931840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.932014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.933153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.933153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.933153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.933153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.933153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.933153] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.933788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2cfa958-414d-4289-8d2b-b26d4bb848ab taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.933889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.933985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.935146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.935146] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2cfa958-414d-4289-8d2b-b26d4bb848ab',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.440738] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.441031] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.441430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.441638] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2cfa958-414d-4289-8d2b-b26d4bb848ab with status ACTIVE [ 887.441949] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.442145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.442202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.442471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.442623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.442904] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.443503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.443637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.443915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.444080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.444491] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.444545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.444639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.446022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.446022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.446022] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2cfa958-414d-4289-8d2b-b26d4bb848ab is going to be updated. [ 887.468452] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.468606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.468647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.468888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.469112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.469259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2cfa958-414d-4289-8d2b-b26d4bb848ab" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.606965] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 in Status: SUCCESS [ 887.607295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.607532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.607802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.608146] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.608335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.608751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.608751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.608751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.608989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.608989] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.947639] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.112422] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.112623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.112662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.112915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.113148] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.113366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.113366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.113588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.113765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.115526] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.115526] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.115526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.115526] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.188531] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 793b8c66-424d-4744-801e-0d08e132ad00 in Status: SUCCESS [ 888.188750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.389575] env[65788]: INFO networking_nsxv3.common.synchronization [None req-9afc2717-cb8b-4edb-8237-29eaeb87a25c tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_rules [ 888.389575] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_rules [ 888.389575] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.389575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.389575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.390186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.390186] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.449817] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.450142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.450142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.450561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.450561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.450561] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c is going to be created. [ 888.477287] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.480026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.480026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.480026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.480026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.490371] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c in Status: UNINITIALIZED for 2s [ 888.520615] env[65788]: INFO networking_nsxv3.common.synchronization [None req-aca97930-6c0b-4a2e-add2-5c788f86889f tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_rules [ 888.520615] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_rules [ 888.520615] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.520615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.618324] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4645a495-ab9e-4045-a0e7-2cc7302cf3e0: rpc.has_security_group_logging(os_id): False [ 888.651963] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.651963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.652171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.652283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.652376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.652581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.652693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.652757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.652922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.653014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.653254] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.653401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.653474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.653634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.653728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.653923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.654045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.654119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.654285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.654373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.654469] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 is going to be created. [ 888.726870] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.727028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.727148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.727358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.727647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.748273] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 in Status: IN_PROGRESS for 2s [ 888.749020] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e in Status: SUCCESS [ 888.749201] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e deletion is rescheduled due to dependency. [ 888.749322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.872547] env[65788]: INFO networking_nsxv3.common.synchronization [req-3499c24d-e513-4b95-be5c-8f022e8abbc9 req-daaf6a53-9773-446a-b6fe-3398860caabc tempest-MigrationsAdminTest-390226756 tempest-MigrationsAdminTest-390226756-project-member] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 888.877635] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 888.878180] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.878612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.878612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.878800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.879010] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.879242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.879319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.879526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.879829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.879829] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.913210] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.913450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.913817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.913817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.913943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.914075] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 already deleted. [ 888.914203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.915067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.915353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.915471] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.385346] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.445132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.445132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.445325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.445522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.445647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.445799] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 already deleted. [ 889.445921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.880027] env[65788]: INFO networking_nsxv3.common.synchronization [req-59f11f1c-98c6-462f-a7a1-426f122e0ad3 req-a5a88154-5790-4cd0-9eaa-dba5b5540c8f tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 889.880578] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 889.881764] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.882077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.882565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.884899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.885096] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.885342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.885342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.885623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.885786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.885951] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.888314] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.306826] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.306826] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.306826] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.307484] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.307923] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.308289] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.311027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.311027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.311027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.311027] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.311027] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.311027] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.311027] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.311027] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.311027] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.311027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.330664] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.330853] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 890.331916] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.331916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.331916] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.331916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.332260] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.332442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.332562] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae9559e-c0a6-45d1-8b3f-97c67f392f2d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.389415] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.389722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.389798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.390091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.391521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.391616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.391616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.391827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.392113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.392113] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be updated. [ 890.413724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.414317] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.414317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.414317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.414449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.414449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.414552] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 890.424577] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.424868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.424868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.428029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.428329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.437705] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: IN_PROGRESS for 2s [ 890.445871] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.446056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.446106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.446311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.446455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.455438] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 890.507776] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c in Status: SUCCESS [ 890.507989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.508171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.508430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.508664] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.508789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.508859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.509033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.509686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.509686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.509686] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.762625] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 in Status: SUCCESS [ 890.762863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.834453] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.834620] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.834748] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.835045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.835215] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.835386] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 5ae9559e-c0a6-45d1-8b3f-97c67f392f2d not found, creating... [ 890.835695] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.835884] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.836025] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.836271] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.836413] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.836721] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.836896] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.837035] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.837257] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.837393] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.837549] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 5ae9559e-c0a6-45d1-8b3f-97c67f392f2d is going to be created. [ 890.858221] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.858623] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.858623] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.858828] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.859117] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.859307] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.012948] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.514750] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c2d9519-fb22-49d0-a2e2-a6d300763f8c: rpc.has_security_group_logging(os_id): False [ 891.535341] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.535583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.535583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.535778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.535883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.536155] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.536272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.536344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.536511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.536624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.536752] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c is going to be created. [ 891.583542] env[65788]: INFO networking_nsxv3.common.synchronization [req-59f11f1c-98c6-462f-a7a1-426f122e0ad3 req-86a8dc21-2022-44fa-878f-370c5a9b639f service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 891.583743] env[65788]: INFO networking_nsxv3.common.synchronization [req-59f11f1c-98c6-462f-a7a1-426f122e0ad3 req-86a8dc21-2022-44fa-878f-370c5a9b639f service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 891.583883] env[65788]: INFO networking_nsxv3.common.synchronization [req-59f11f1c-98c6-462f-a7a1-426f122e0ad3 req-86a8dc21-2022-44fa-878f-370c5a9b639f service nova] Enqueued Resource ID: 5ae9559e-c0a6-45d1-8b3f-97c67f392f2d with Priority: HIGHEST for action port [ 891.584666] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 891.584843] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 891.584944] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae9559e-c0a6-45d1-8b3f-97c67f392f2d with Priority: HIGHEST for action port [ 891.585263] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.585395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.585461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.585756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.586148] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.587191] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.587348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.587585] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.588213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.588213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.588213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.588213] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae9559e-c0a6-45d1-8b3f-97c67f392f2d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.639237] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.639676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.639676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.639676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.639897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.654703] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c in Status: IN_PROGRESS for 2s [ 892.090288] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.090669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.090669] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ae9559e-c0a6-45d1-8b3f-97c67f392f2d with status ACTIVE [ 892.090867] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.090984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.091110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.091277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.091367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.091541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.091640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.091704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.091861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.091940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.092148] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.092341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.092476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.092645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.092732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.092829] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ae9559e-c0a6-45d1-8b3f-97c67f392f2d is going to be updated. [ 892.115110] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.115276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.115362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.115567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.115720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.115896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ae9559e-c0a6-45d1-8b3f-97c67f392f2d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.451848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 892.451848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.468623] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 892.468623] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 892.468878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.469192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.469488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.469723] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.469905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.470026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.470283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.470414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.470553] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.972470] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.476267] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.669126] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c in Status: SUCCESS [ 893.669355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.979132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.979390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.979508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.980115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.980115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.980314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 894.034054] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.034230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.034271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.034486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.034638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.044659] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 895.325620] env[65788]: INFO networking_nsxv3.common.synchronization [req-c9b5363a-a0a6-49b8-9c29-7618ce35031d req-b626ca80-219d-42fb-a99c-d49027444c5f tempest-ImagesOneServerTestJSON-1972491077 tempest-ImagesOneServerTestJSON-1972491077-project-member] Enqueued Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_members [ 895.326446] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c with Priority: HIGHEST for action security_group_members [ 895.326834] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.327014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.327137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.327291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.327462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.327581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.327643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.327791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.327876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.327986] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a0f6ea-2705-4f7e-89ce-48ee3f2db28c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.830562] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.830750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.830797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.831051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.831152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.831412] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.831545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.831613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.832168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.832407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.832511] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c is going to be updated. [ 895.880494] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.880494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.880494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.880734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.882410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.897575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c in Status: IN_PROGRESS for 2s [ 896.059866] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 896.059866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.060144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.060492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.060704] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.060835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.060904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.061115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.061250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.061366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.061467] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.565430] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.565749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.565749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.565887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.566064] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.566172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.566235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.566383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.566462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.566548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.566693] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.566777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.567014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.567014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.567125] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.567363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.567363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.567440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.567517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.567611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.568558] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.073903] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f8fa77-dfd6-4877-84c2-f9760d23fdfb: rpc.has_security_group_logging(os_id): False [ 897.091469] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.091691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.091691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.091894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.091982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.092210] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.092344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.092393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.092544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.092623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.092800] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.092893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.092954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.093141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.093250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.093441] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.093538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.093600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.093765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.093805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.093892] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 897.166088] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.166330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.166330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.166511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.166658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.180795] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 897.269201] env[65788]: INFO networking_nsxv3.common.synchronization [req-7ed8445a-e43d-4bda-a0ff-dd7a57cc32b2 req-1d3b093e-2aee-40ce-a91d-3e0c1a8ecbf8 tempest-InstanceActionsNegativeTestJSON-1995453059 tempest-InstanceActionsNegativeTestJSON-1995453059-project-member] Enqueued Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_members [ 897.269788] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGHEST for action security_group_members [ 897.270247] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.270419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.270482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.270692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.270856] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.271109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.271109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.271245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.271340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.271392] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.510069] env[65788]: INFO networking_nsxv3.common.synchronization [req-eee46f35-93b0-4617-a9ac-5900aad526e1 req-cfbb8614-d43a-408a-a098-6bee02394266 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 897.510657] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 897.511986] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.511986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.511986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.511986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.513623] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.513846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.513934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.514132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.514226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.514328] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.773521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.773838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.773838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.773969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.774036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.774219] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.774331] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.774396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.774571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.774678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.774768] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 is going to be updated. [ 897.806731] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.806908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.807010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.807161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.807300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.819145] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.819382] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.819569] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.820416] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.820416] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.820557] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.820733] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.821049] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.821236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.821644] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.821790] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.821942] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.822153] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.823191] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.823344] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.823503] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.825520] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 in Status: IN_PROGRESS for 2s [ 897.842794] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.842976] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.843103] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.843284] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.843607] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-61939e8e-83bb-4b70-87c3-5e59e3f961f3 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.843779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.843896] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.844247] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.844390] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61939e8e-83bb-4b70-87c3-5e59e3f961f3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.913341] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c in Status: SUCCESS [ 897.913525] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a0f6ea-2705-4f7e-89ce-48ee3f2db28c deletion is rescheduled due to dependency. [ 897.913623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a0f6ea-2705-4f7e-89ce-48ee3f2db28c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.017132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.017302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.017378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.017613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.017717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.018015] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.018147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.018232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.018396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.018488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.018576] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 already deleted. [ 898.018681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.346963] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.347408] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.347408] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.347650] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.347805] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.347958] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 61939e8e-83bb-4b70-87c3-5e59e3f961f3 not found, creating... [ 898.348241] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.348407] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.348523] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.348745] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.348979] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.349732] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.349906] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.350044] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.350286] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.351047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.351047] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 61939e8e-83bb-4b70-87c3-5e59e3f961f3 is going to be created. [ 898.376212] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.376212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.376212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.376212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.376556] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.376689] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.114027] env[65788]: INFO networking_nsxv3.common.synchronization [req-eee46f35-93b0-4617-a9ac-5900aad526e1 req-8eef9c1a-a18d-41a9-b208-7cfd696f3f3c service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 899.114294] env[65788]: INFO networking_nsxv3.common.synchronization [req-eee46f35-93b0-4617-a9ac-5900aad526e1 req-8eef9c1a-a18d-41a9-b208-7cfd696f3f3c service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 899.116899] env[65788]: INFO networking_nsxv3.common.synchronization [req-eee46f35-93b0-4617-a9ac-5900aad526e1 req-8eef9c1a-a18d-41a9-b208-7cfd696f3f3c service nova] Enqueued Resource ID: 61939e8e-83bb-4b70-87c3-5e59e3f961f3 with Priority: HIGHEST for action port [ 899.116899] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 899.116899] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 899.116899] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61939e8e-83bb-4b70-87c3-5e59e3f961f3 with Priority: HIGHEST for action port [ 899.116899] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.116899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.116899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.116899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.116899] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.118079] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.118195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.118237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.118641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.118641] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.118745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.118745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.119033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.119033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.119144] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.120065] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-61939e8e-83bb-4b70-87c3-5e59e3f961f3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.120538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.120538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.120538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.120538] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61939e8e-83bb-4b70-87c3-5e59e3f961f3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.197025] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 899.197182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.622722] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.623689] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.623826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.624044] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61939e8e-83bb-4b70-87c3-5e59e3f961f3 with status ACTIVE [ 899.624248] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.624380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.624483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.625106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.625106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.625106] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.625281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.625281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.625455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.625509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.625714] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.625937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.625937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.626290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.626290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.626368] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61939e8e-83bb-4b70-87c3-5e59e3f961f3 is going to be updated. [ 899.648969] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.649170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.649260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.649491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.649637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.649806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61939e8e-83bb-4b70-87c3-5e59e3f961f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.836463] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 in Status: SUCCESS [ 899.836746] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 deletion is rescheduled due to dependency. [ 899.836879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.128488] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.630953] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.631240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.631342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.631594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.631712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.631949] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be created. [ 900.661982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.662227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.662397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.662617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.662781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.671953] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: UNINITIALIZED for 2s [ 900.713890] env[65788]: INFO networking_nsxv3.common.synchronization [req-e7851661-6f8d-49c3-9a8b-5ab14ebd7d70 req-26cb12ba-279c-4680-a1ae-4b69389b285c tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_members [ 900.714490] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_members [ 900.714804] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.714918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.715017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.715293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.715456] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.715561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.715624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.715818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.715921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.716041] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.074168] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.074377] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.074503] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.074868] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.075185] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.075350] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.075469] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.075692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.075835] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.076234] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.076385] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.076499] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.076607] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.076720] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.076822] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.076982] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.103502] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.103502] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.103616] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.103707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.104048] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-e3e7d668-9071-4020-8d8e-6f98765b857e taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.104551] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.104551] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.104740] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.104886] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e7d668-9071-4020-8d8e-6f98765b857e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.218546] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.219351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.219351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.219351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.219351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.219471] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.219580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.219650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.219826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.219934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.220064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 already deleted. [ 901.220210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.607395] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.607586] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.607758] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.607965] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.608143] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.608357] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port e3e7d668-9071-4020-8d8e-6f98765b857e not found, creating... [ 901.608680] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.608850] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.608969] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.609207] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.609340] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.609630] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.609823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.609943] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.610173] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.610322] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.610464] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: e3e7d668-9071-4020-8d8e-6f98765b857e is going to be created. [ 901.631507] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.631779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.631857] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.632172] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.632504] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.632742] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.359669] env[65788]: INFO networking_nsxv3.common.synchronization [req-e7851661-6f8d-49c3-9a8b-5ab14ebd7d70 req-0605be18-011b-40bf-9cd6-e23f938d5ab1 service nova] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_rules [ 902.360333] env[65788]: INFO networking_nsxv3.common.synchronization [req-e7851661-6f8d-49c3-9a8b-5ab14ebd7d70 req-0605be18-011b-40bf-9cd6-e23f938d5ab1 service nova] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_members [ 902.360494] env[65788]: INFO networking_nsxv3.common.synchronization [req-e7851661-6f8d-49c3-9a8b-5ab14ebd7d70 req-0605be18-011b-40bf-9cd6-e23f938d5ab1 service nova] Enqueued Resource ID: e3e7d668-9071-4020-8d8e-6f98765b857e with Priority: HIGHEST for action port [ 902.361130] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_rules [ 902.361231] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_members [ 902.361331] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e7d668-9071-4020-8d8e-6f98765b857e with Priority: HIGHEST for action port [ 902.361612] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.361742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.361812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.362026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.362099] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.363565] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.363701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.363772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.364019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.364258] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.364384] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.364511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.364655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.364736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.364833] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.366593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3e7d668-9071-4020-8d8e-6f98765b857e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.366742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.366822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.367019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.367164] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e7d668-9071-4020-8d8e-6f98765b857e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.683923] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 902.683923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.683923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.684227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.684618] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.684741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.684826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.684998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.685098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.685189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.685287] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.866781] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.869399] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3e7d668-9071-4020-8d8e-6f98765b857e with status ACTIVE [ 902.870197] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.870364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.870438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.870660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.870957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.871034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.871147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.871207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.871377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.871465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.871652] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.871747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.871809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.871948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.872091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.872186] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3e7d668-9071-4020-8d8e-6f98765b857e is going to be updated. [ 902.873389] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.873489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.903751] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.903751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.903751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.903751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.903751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.903751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3e7d668-9071-4020-8d8e-6f98765b857e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.188804] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.188804] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.188804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.189337] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.189337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.189337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.189337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.189449] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.189486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.189519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.190611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.190611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.190611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.190611] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.368357] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.374865] env[65788]: INFO networking_nsxv3.common.synchronization [req-ac72333d-429d-4aef-b840-4ec72cb14a8a req-86b01c18-3b50-4571-9948-10c15bcfb3dd tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 903.375810] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 903.376178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.376300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.376347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.376589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.376750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.376848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.376901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.377075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.377161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.377255] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.693649] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5: rpc.has_security_group_logging(os_id): False [ 903.713366] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.713589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.713646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.713842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.713933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.714164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.714281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.714364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.714496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.714576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.714753] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.714846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.714905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.716105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.716346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.716504] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.716606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.716673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.716821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.716918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.717012] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be created. [ 903.842810] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.842810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.842810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.843390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.843511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.856255] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 903.872771] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.872771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.872771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.872771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.872771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.872771] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 is going to be created. [ 903.874894] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.874894] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.874894] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.874894] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.875125] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.875226] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.875414] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.876039] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.876039] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.876039] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.876039] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.876222] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.876222] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.876369] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.876432] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.877044] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.879858] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.879970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.880055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.880264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.880356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.880572] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.880674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.880752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.880904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.881042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.881089] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d already deleted. [ 903.881201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.901131] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.901318] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.903837] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.903837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.903837] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-a389e040-bcb4-4a0a-8319-05d185c71a4e taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.903837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.903837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.903837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.903837] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a389e040-bcb4-4a0a-8319-05d185c71a4e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.906802] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.906936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.907013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.907215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.907376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.918789] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: UNINITIALIZED for 2s [ 904.407078] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.407078] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.407078] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.407527] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.407527] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.407527] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port a389e040-bcb4-4a0a-8319-05d185c71a4e not found, creating... [ 904.408200] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.408200] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.408200] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.408200] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.408445] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.408583] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.408740] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.408853] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.409095] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.409238] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.409378] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: a389e040-bcb4-4a0a-8319-05d185c71a4e is going to be created. [ 904.430766] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.430992] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.431129] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.431390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.431628] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.431855] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.165182] env[65788]: INFO networking_nsxv3.common.synchronization [req-ac72333d-429d-4aef-b840-4ec72cb14a8a req-c60cb9a3-2c35-4527-9ab1-2919b5d7db7f service nova] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 905.165370] env[65788]: INFO networking_nsxv3.common.synchronization [req-ac72333d-429d-4aef-b840-4ec72cb14a8a req-c60cb9a3-2c35-4527-9ab1-2919b5d7db7f service nova] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 905.165506] env[65788]: INFO networking_nsxv3.common.synchronization [req-ac72333d-429d-4aef-b840-4ec72cb14a8a req-c60cb9a3-2c35-4527-9ab1-2919b5d7db7f service nova] Enqueued Resource ID: a389e040-bcb4-4a0a-8319-05d185c71a4e with Priority: HIGHEST for action port [ 905.166190] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 905.166442] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 905.166588] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a389e040-bcb4-4a0a-8319-05d185c71a4e with Priority: HIGHEST for action port [ 905.166905] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.167288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.167431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.167717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.167852] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.168839] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.169030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.169621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.169621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.169621] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.169809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.170175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.170175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.170175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.170435] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.172607] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-a389e040-bcb4-4a0a-8319-05d185c71a4e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.172789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.172906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.173101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.173184] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a389e040-bcb4-4a0a-8319-05d185c71a4e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.676619] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.676877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.676962] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.677841] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a389e040-bcb4-4a0a-8319-05d185c71a4e with status ACTIVE [ 905.678041] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.678154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.678220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.678414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.678500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.678673] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.678765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.678825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.678968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.679114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.679492] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.679600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.679662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.679804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.679879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.679965] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a389e040-bcb4-4a0a-8319-05d185c71a4e is going to be updated. [ 905.703972] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.704129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.704997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.704997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.704997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.704997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a389e040-bcb4-4a0a-8319-05d185c71a4e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.868471] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 905.869339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.933033] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: SUCCESS [ 905.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.933033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.933033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.933508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.933741] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.182304] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.436794] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.685936] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.685936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.685936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.686406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.686406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.686406] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be created. [ 906.717307] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.717506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.717506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.717733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.717893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.742761] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: UNINITIALIZED for 2s [ 906.946587] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b366224-1a8e-4eba-8bca-4fdd69ef52e9: rpc.has_security_group_logging(os_id): False [ 906.963968] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.964148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.964245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.964429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.964520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.964869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.964869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.965013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.965204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.965204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.965303] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 is going to be created. [ 907.037057] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.038264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.038264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.038264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.038264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.054034] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: IN_PROGRESS for 2s [ 908.116982] env[65788]: INFO networking_nsxv3.common.synchronization [req-6059980b-928f-4397-bf95-e7cb36a12bf6 req-e68f1fc4-6ea9-4554-b5d5-2c621c2e57ee tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 908.117705] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 908.119534] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.119826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.119980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.120320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.120597] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.120783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.120911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.121194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.121435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.121567] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.627521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.627521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.627804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.627984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.628146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.628736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.629705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.629705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.629705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.629705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.629705] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 908.660748] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.660986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.660986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.661216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.661456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.672178] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 908.732686] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.732686] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.733000] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.733078] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.733413] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.733574] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.733761] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.733889] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.734045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.734297] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.734426] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.734567] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.734787] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.734961] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.735152] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.735387] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.776336] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 908.777569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.777569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.777706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.777849] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.777931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.778081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.778161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.778243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.778331] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.778433] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.784338] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.784338] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.784490] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.784551] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.786426] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-75feeed4-e6af-473c-a526-44dce6db7bdd taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.786426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.786426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.786426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.786426] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75feeed4-e6af-473c-a526-44dce6db7bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.068476] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: SUCCESS [ 909.068567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.287536] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.288834] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.289059] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.289225] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.289457] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.289602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.289767] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 75feeed4-e6af-473c-a526-44dce6db7bdd not found, creating... [ 909.290018] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.290180] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.290348] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.290577] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.290734] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.290994] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.291162] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.291276] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.291564] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.291717] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.291857] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 75feeed4-e6af-473c-a526-44dce6db7bdd is going to be created. [ 909.311162] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.311422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.311548] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.311838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.312084] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.312355] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.794211] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78cf75a9-6fba-4c9b-bfad-3d1090cb819d: rpc.has_security_group_logging(os_id): False [ 909.817438] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.817651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.817983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.817983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.818092] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.818396] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.818508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.818570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.818726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.818888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.818919] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be created. [ 909.893472] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.893618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.893690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.893896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.894095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.910725] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 910.131402] env[65788]: INFO networking_nsxv3.common.synchronization [req-6059980b-928f-4397-bf95-e7cb36a12bf6 req-b254d215-5345-42e4-975d-5a10b904f702 service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 910.131803] env[65788]: INFO networking_nsxv3.common.synchronization [req-6059980b-928f-4397-bf95-e7cb36a12bf6 req-b254d215-5345-42e4-975d-5a10b904f702 service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 910.131964] env[65788]: INFO networking_nsxv3.common.synchronization [req-6059980b-928f-4397-bf95-e7cb36a12bf6 req-b254d215-5345-42e4-975d-5a10b904f702 service nova] Enqueued Resource ID: 75feeed4-e6af-473c-a526-44dce6db7bdd with Priority: HIGHEST for action port [ 910.132602] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 910.133110] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 910.133110] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75feeed4-e6af-473c-a526-44dce6db7bdd with Priority: HIGHEST for action port [ 910.133202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.133429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.133429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.133643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.133758] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.135202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.135341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.135555] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-75feeed4-e6af-473c-a526-44dce6db7bdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.135808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.135808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.135899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.135969] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75feeed4-e6af-473c-a526-44dce6db7bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.525088] env[65788]: INFO networking_nsxv3.common.synchronization [req-4d638a80-5e87-4930-8327-d5f29e845af8 req-7d4983d7-11c1-48d0-8733-5979a5752eca tempest-ListImageFiltersTestJSON-1319309490 tempest-ListImageFiltersTestJSON-1319309490-project-member] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 910.525646] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 910.525950] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.526670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.526754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.527057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.527238] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.527351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.527416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.527579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.527663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.527756] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.639142] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.639142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.639142] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75feeed4-e6af-473c-a526-44dce6db7bdd with status ACTIVE [ 910.639401] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.639596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.639644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.640576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.640576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.640576] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.640576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.640805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.640935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.640969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.641294] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.641447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.641568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.641700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.641802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.641949] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75feeed4-e6af-473c-a526-44dce6db7bdd is going to be updated. [ 910.666748] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.666984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.667066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.667345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.667545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.667747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75feeed4-e6af-473c-a526-44dce6db7bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.687152] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 910.687152] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 910.687152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.687152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.687152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.687152] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.687152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.687152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.687152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.687152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.687152] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.032468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.032468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.032468] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 already deleted. [ 911.032468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.190963] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.254269] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.254466] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.254584] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.254993] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.255214] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.255341] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.255458] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.256494] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.256494] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.256494] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.256494] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.256494] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.256710] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.256710] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.256763] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.256893] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.283870] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.284060] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.284195] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.284375] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.284720] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-66e12b2e-e5e0-4f1b-a826-14fe937c3082 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.284894] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.285016] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.285394] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.285526] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66e12b2e-e5e0-4f1b-a826-14fe937c3082',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.697153] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.788249] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.788526] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.788686] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.789061] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.789245] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.789473] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 66e12b2e-e5e0-4f1b-a826-14fe937c3082 not found, creating... [ 911.789975] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.790098] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.790262] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.790559] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.790736] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.791320] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.791422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.791527] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.791812] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.791997] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.792198] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 66e12b2e-e5e0-4f1b-a826-14fe937c3082 is going to be created. [ 911.818037] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.818329] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.818505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.818879] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.819198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.819480] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.925808] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 911.926135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.200714] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.200714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.200714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.200714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.200714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.200714] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 912.229207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.229207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.229207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.229417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.229554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.241192] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 912.373850] env[65788]: INFO networking_nsxv3.common.synchronization [None req-1c61e3d8-dbc6-4232-a1b8-b8c4c60c35de None None] Enqueued Resource ID: 1f5ea6a7-fa5d-4eef-a320-2114ac67f741 with Priority: HIGHEST for action port [ 912.373850] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5ea6a7-fa5d-4eef-a320-2114ac67f741 with Priority: HIGHEST for action port [ 912.373850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f5ea6a7-fa5d-4eef-a320-2114ac67f741 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.373850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f5ea6a7-fa5d-4eef-a320-2114ac67f741" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.373850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f5ea6a7-fa5d-4eef-a320-2114ac67f741" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.374510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f5ea6a7-fa5d-4eef-a320-2114ac67f741" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.374826] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f5ea6a7-fa5d-4eef-a320-2114ac67f741',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.539333] env[65788]: INFO networking_nsxv3.common.synchronization [req-4d638a80-5e87-4930-8327-d5f29e845af8 req-4313c51e-969b-4c65-84ab-3e655f73abf2 service nova] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_rules [ 912.539333] env[65788]: INFO networking_nsxv3.common.synchronization [req-4d638a80-5e87-4930-8327-d5f29e845af8 req-4313c51e-969b-4c65-84ab-3e655f73abf2 service nova] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 912.539333] env[65788]: INFO networking_nsxv3.common.synchronization [req-4d638a80-5e87-4930-8327-d5f29e845af8 req-4313c51e-969b-4c65-84ab-3e655f73abf2 service nova] Enqueued Resource ID: 66e12b2e-e5e0-4f1b-a826-14fe937c3082 with Priority: HIGHEST for action port [ 912.539333] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_rules [ 912.539333] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 912.539333] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66e12b2e-e5e0-4f1b-a826-14fe937c3082 with Priority: HIGHEST for action port [ 912.539333] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.539333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.539333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.540919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.541123] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.542094] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.542340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.542585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.542849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.543103] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.543298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.543441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.545018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.545018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.545018] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.545018] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-66e12b2e-e5e0-4f1b-a826-14fe937c3082 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.545018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.545018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.545018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.545431] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66e12b2e-e5e0-4f1b-a826-14fe937c3082',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.876502] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f5ea6a7-fa5d-4eef-a320-2114ac67f741 [ 912.876866] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.877133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.877270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.877492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.877586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.878418] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f5ea6a7-fa5d-4eef-a320-2114ac67f741 already deleted. [ 912.878418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f5ea6a7-fa5d-4eef-a320-2114ac67f741" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.051024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.051024] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.051024] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66e12b2e-e5e0-4f1b-a826-14fe937c3082 with status ACTIVE [ 913.051024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.051024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.051024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.051749] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.051749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.051749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.051749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.051749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.051749] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66e12b2e-e5e0-4f1b-a826-14fe937c3082 is going to be updated. [ 913.076556] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.076556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.076556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.076556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.076556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.076556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66e12b2e-e5e0-4f1b-a826-14fe937c3082" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.453432] env[65788]: INFO networking_nsxv3.common.synchronization [req-7bfe578f-332d-497b-8f16-1f2caf26060e req-45aa79f4-b804-4f12-978f-7a8d245e42b8 tempest-ListImageFiltersTestJSON-1319309490 tempest-ListImageFiltersTestJSON-1319309490-project-member] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 913.454204] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 913.454633] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.454764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.555845] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.058655] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.059047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.059047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.059194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.059406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.060208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 is going to be created. [ 914.088415] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.088793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.088793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.088973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.089265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.100967] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: UNINITIALIZED for 2s [ 914.252556] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 914.252798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.252992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.253252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.253682] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.253682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.253682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.253893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.253938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.254255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.254255] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.263462] env[65788]: INFO networking_nsxv3.common.synchronization [None req-0ea7f5d8-538b-44e2-869e-93071645c090 None None] Enqueued Resource ID: 888ac210-1e80-43cc-b9f9-f47a6ec807ae with Priority: HIGHEST for action port [ 914.264042] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 888ac210-1e80-43cc-b9f9-f47a6ec807ae with Priority: HIGHEST for action port [ 914.264366] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-888ac210-1e80-43cc-b9f9-f47a6ec807ae taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.264488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-888ac210-1e80-43cc-b9f9-f47a6ec807ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.264586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-888ac210-1e80-43cc-b9f9-f47a6ec807ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.264872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-888ac210-1e80-43cc-b9f9-f47a6ec807ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.265729] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('888ac210-1e80-43cc-b9f9-f47a6ec807ae',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.365089] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.365297] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.365422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.365686] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.365948] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.366383] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.366525] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.366754] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.366945] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.367344] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.367481] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.367587] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.367709] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.367822] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.367931] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.368278] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.388860] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.389042] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 914.389191] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.389364] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.389830] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-f7942d4f-6888-4c90-9483-9418e660ab54 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.389954] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.389989] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.390397] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.390542] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7942d4f-6888-4c90-9483-9418e660ab54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.757074] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.757214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.757214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.757524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.758112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.758112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.758112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.758112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.758112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.758530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.758530] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.758530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.758530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.758759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.758959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.758959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.759117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.760114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.760114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.760114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.760114] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.769529] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 888ac210-1e80-43cc-b9f9-f47a6ec807ae [ 914.770522] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.770522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.770522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.770713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.770827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.770942] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:888ac210-1e80-43cc-b9f9-f47a6ec807ae already deleted. [ 914.771201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-888ac210-1e80-43cc-b9f9-f47a6ec807ae" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.894086] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.895283] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.895691] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.896110] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.896236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.896534] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port f7942d4f-6888-4c90-9483-9418e660ab54 not found, creating... [ 914.897815] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.898014] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.898151] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.898426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.898537] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.898861] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.900465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.900465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.900465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.900465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.901083] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: f7942d4f-6888-4c90-9483-9418e660ab54 is going to be created. [ 914.925062] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.925062] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.925062] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.925062] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.925062] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.925898] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.262469] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605d7441-fa35-48f3-be10-861643ff1c6c: rpc.has_security_group_logging(os_id): False [ 915.287909] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.288256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.288503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.288859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.291019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.291019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.291019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.291840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.292418] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.293442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.295713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.295713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.295713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.295713] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 915.358111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.358111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.358111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.358111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.358111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.373607] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 915.389877] env[65788]: INFO networking_nsxv3.common.synchronization [None req-eb894859-b900-4122-98e7-6a279c1c6941 None None] Enqueued Resource ID: 0badc820-f9fa-4820-9c5e-833a9d221660 with Priority: HIGHEST for action port [ 915.390150] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0badc820-f9fa-4820-9c5e-833a9d221660 with Priority: HIGHEST for action port [ 915.390788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0badc820-f9fa-4820-9c5e-833a9d221660 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.390908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0badc820-f9fa-4820-9c5e-833a9d221660" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.390981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0badc820-f9fa-4820-9c5e-833a9d221660" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.391446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0badc820-f9fa-4820-9c5e-833a9d221660" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.391588] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0badc820-f9fa-4820-9c5e-833a9d221660',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.895211] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0badc820-f9fa-4820-9c5e-833a9d221660 [ 915.895536] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.895747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.896184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.896674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.896674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.896674] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0badc820-f9fa-4820-9c5e-833a9d221660 already deleted. [ 915.896884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0badc820-f9fa-4820-9c5e-833a9d221660" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.117076] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: SUCCESS [ 916.117307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.117502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.117721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.117923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.118066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.118134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.118286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.118374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.118460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.118598] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.119466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.119628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.119801] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.119928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.120574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.120574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.120574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.120574] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.175143] env[65788]: INFO networking_nsxv3.common.synchronization [req-7bfe578f-332d-497b-8f16-1f2caf26060e req-1209f7ea-5c05-4945-b909-87cfef1f39a8 service nova] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_rules [ 916.175638] env[65788]: INFO networking_nsxv3.common.synchronization [req-7bfe578f-332d-497b-8f16-1f2caf26060e req-1209f7ea-5c05-4945-b909-87cfef1f39a8 service nova] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 916.175638] env[65788]: INFO networking_nsxv3.common.synchronization [req-7bfe578f-332d-497b-8f16-1f2caf26060e req-1209f7ea-5c05-4945-b909-87cfef1f39a8 service nova] Enqueued Resource ID: f7942d4f-6888-4c90-9483-9418e660ab54 with Priority: HIGHEST for action port [ 916.176025] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_rules [ 916.177126] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 916.177313] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7942d4f-6888-4c90-9483-9418e660ab54 with Priority: HIGHEST for action port [ 916.178925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.178925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.178925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.178925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.178925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7942d4f-6888-4c90-9483-9418e660ab54 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.178925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.178925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.178925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.178925] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7942d4f-6888-4c90-9483-9418e660ab54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.622275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.624226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.624226] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.680796] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7942d4f-6888-4c90-9483-9418e660ab54 with status ACTIVE [ 916.681083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.681223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.681291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.681510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.681628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.682218] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.682218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.682218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.682218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.682218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.682458] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.682520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.682564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.682692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.682754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.682866] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7942d4f-6888-4c90-9483-9418e660ab54 is going to be updated. [ 916.710219] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.710219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.710219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.710219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.710219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.710219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7942d4f-6888-4c90-9483-9418e660ab54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.719148] env[65788]: INFO networking_nsxv3.common.synchronization [req-11940cdc-100d-4da8-8dab-573ff9ff0261 req-7bfbaaa5-1abc-41d9-ad4d-fdcd95064748 tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_members [ 916.719148] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_members [ 916.719944] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.720093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.720433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.762051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.762331] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.762466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.762576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.762785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.762871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.762988] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.126770] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.267132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.267132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.267132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.267132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.267132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.267411] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.267411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.267411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.267559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.267559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.268428] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 already deleted. [ 917.268428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.389125] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 917.389346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.560446] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.560828] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.561067] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.561436] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.561800] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.562112] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.562360] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.562692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.565849] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.566202] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.566408] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.566593] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.566793] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.568021] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.568021] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.568021] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.589233] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.589233] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.589233] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.589233] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.589233] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-f77387e5-802c-49e8-996a-0d6742eb30be taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.589233] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.589233] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.589233] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.589233] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77387e5-802c-49e8-996a-0d6742eb30be',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.630450] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.631109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.632189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.632509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.632605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.632722] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 is going to be updated. [ 917.664140] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.664437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.664437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.664703] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.666045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.676650] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: IN_PROGRESS for 2s [ 917.962621] env[65788]: INFO networking_nsxv3.common.synchronization [None req-63e383dc-c965-4be3-8790-e2458bab949a None None] Enqueued Resource ID: 87016edf-903b-4aaf-bcef-c5b99343b7f7 with Priority: HIGHEST for action port [ 917.963066] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87016edf-903b-4aaf-bcef-c5b99343b7f7 with Priority: HIGHEST for action port [ 917.963444] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-87016edf-903b-4aaf-bcef-c5b99343b7f7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.963550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87016edf-903b-4aaf-bcef-c5b99343b7f7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.963586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87016edf-903b-4aaf-bcef-c5b99343b7f7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.963919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87016edf-903b-4aaf-bcef-c5b99343b7f7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.963919] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87016edf-903b-4aaf-bcef-c5b99343b7f7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.091121] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.091414] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.091609] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.091987] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.092592] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.092592] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port f77387e5-802c-49e8-996a-0d6742eb30be not found, creating... [ 918.093086] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.093086] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.093086] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.093695] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.093695] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.093782] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.094088] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.094180] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.094505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.094719] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.094954] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: f77387e5-802c-49e8-996a-0d6742eb30be is going to be created. [ 918.119402] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.122918] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.123042] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.123498] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.123661] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.123916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.284059] env[65788]: INFO networking_nsxv3.common.synchronization [None req-8a6c192a-6c1a-4fac-97b8-63fc88bcb70e None None] Enqueued Resource ID: b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8 with Priority: HIGHEST for action port [ 918.287663] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8 with Priority: HIGHEST for action port [ 918.287663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.287663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.287663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.287663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.287663] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.467344] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87016edf-903b-4aaf-bcef-c5b99343b7f7 [ 918.467577] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.467832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.467832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.468077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.468125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.468205] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87016edf-903b-4aaf-bcef-c5b99343b7f7 already deleted. [ 918.468283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87016edf-903b-4aaf-bcef-c5b99343b7f7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.669356] env[65788]: INFO networking_nsxv3.common.synchronization [req-e747f20d-86d9-46cd-992e-b55825eee4d7 req-7c598297-8542-44d6-aee6-35f65f3e348d tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 918.669889] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 918.674196] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.674196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.674196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.674196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674196] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.674196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.674196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.674196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.674196] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.793064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8 [ 918.793064] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.793064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.793064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.793064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.793064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.793064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8 already deleted. [ 918.793064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6ebc6d4-83e1-4ed2-aa08-5625a6c44ab8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.887203] env[65788]: INFO networking_nsxv3.common.synchronization [req-11940cdc-100d-4da8-8dab-573ff9ff0261 req-c9acc27b-d4a1-4846-9476-d2a3b5c4a886 service nova] Enqueued Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_rules [ 918.887627] env[65788]: INFO networking_nsxv3.common.synchronization [req-11940cdc-100d-4da8-8dab-573ff9ff0261 req-c9acc27b-d4a1-4846-9476-d2a3b5c4a886 service nova] Enqueued Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_members [ 918.887798] env[65788]: INFO networking_nsxv3.common.synchronization [req-11940cdc-100d-4da8-8dab-573ff9ff0261 req-c9acc27b-d4a1-4846-9476-d2a3b5c4a886 service nova] Enqueued Resource ID: f77387e5-802c-49e8-996a-0d6742eb30be with Priority: HIGHEST for action port [ 918.891019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_rules [ 918.891019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_members [ 918.891019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77387e5-802c-49e8-996a-0d6742eb30be with Priority: HIGHEST for action port [ 918.891019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.891019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.891019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.891019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.891019] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.891019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.891019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.891019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.891760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.891760] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.891760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.891760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.892170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.892170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.892170] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.893454] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f77387e5-802c-49e8-996a-0d6742eb30be taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.893608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.893735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.894058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.894165] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77387e5-802c-49e8-996a-0d6742eb30be',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.175747] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.308839] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.309047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.309152] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.309413] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.309664] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.309811] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.310223] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.310223] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.310301] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.310752] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.310752] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.310752] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.310869] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.310915] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.310977] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.311111] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.332137] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.332481] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 919.332481] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.332651] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.333651] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-1e1e18cc-d04a-4d27-86cd-4322e132974b taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.333651] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.333651] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.333651] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.333867] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e1e18cc-d04a-4d27-86cd-4322e132974b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.396070] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.396207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.396407] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.397355] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f77387e5-802c-49e8-996a-0d6742eb30be with status ACTIVE [ 919.397586] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.397690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.397755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.398709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.398709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.398709] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.398709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.398709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.398709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.398709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.399202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.399202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.399202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.399386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.399441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.399591] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f77387e5-802c-49e8-996a-0d6742eb30be is going to be updated. [ 919.426810] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.426978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.427053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.427261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.427400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.427560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f77387e5-802c-49e8-996a-0d6742eb30be" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.561996] env[65788]: INFO networking_nsxv3.common.synchronization [req-03958a7a-ee0c-4b1d-b4fa-536615336041 req-8f14f9d0-c73c-4445-9e15-7284363f2d2a tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 919.562692] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 919.563016] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.564418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.564487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.564718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.564923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.565045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.565111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.565277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.565391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.565547] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.677870] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.696787] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: SUCCESS [ 919.697069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.697490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.697705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.697891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.698032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.699357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.699614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.699784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.700225] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.842073] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.842073] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 1e1e18cc-d04a-4d27-86cd-4322e132974b not found, creating... [ 919.842073] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.842073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.842848] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.842848] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.842848] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.842848] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.842848] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.842848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 1e1e18cc-d04a-4d27-86cd-4322e132974b is going to be created. [ 919.876930] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.877149] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.877319] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.877695] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.877994] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.878258] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.902964] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.069081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.069257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.069330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.069608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.069719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.070765] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.070765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.070765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.070765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.070765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.070765] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 920.103023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.103023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.103023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.103023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.103023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.112282] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 920.186195] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.186424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.186526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.186866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.186866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.186987] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 920.202906] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.215023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.215199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.215243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.215450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.215622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.226157] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 920.405119] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.405285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.405342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.405563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.405655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.406131] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 is going to be created. [ 920.431304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.431455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.431529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.431748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.431908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.441958] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 in Status: UNINITIALIZED for 2s [ 920.592877] env[65788]: INFO networking_nsxv3.common.synchronization [req-e747f20d-86d9-46cd-992e-b55825eee4d7 req-a57a5b36-d14a-44a9-8613-b94e9dfffbea service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 920.592877] env[65788]: INFO networking_nsxv3.common.synchronization [req-e747f20d-86d9-46cd-992e-b55825eee4d7 req-a57a5b36-d14a-44a9-8613-b94e9dfffbea service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 920.592877] env[65788]: INFO networking_nsxv3.common.synchronization [req-e747f20d-86d9-46cd-992e-b55825eee4d7 req-a57a5b36-d14a-44a9-8613-b94e9dfffbea service nova] Enqueued Resource ID: 1e1e18cc-d04a-4d27-86cd-4322e132974b with Priority: HIGHEST for action port [ 920.593139] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 920.593278] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 920.593572] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e1e18cc-d04a-4d27-86cd-4322e132974b with Priority: HIGHEST for action port [ 920.593978] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.594194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.594304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.594571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.594714] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.595917] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.596082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.596336] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e1e18cc-d04a-4d27-86cd-4322e132974b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.596510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.596625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.596927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.597088] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e1e18cc-d04a-4d27-86cd-4322e132974b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.706019] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.024991] env[65788]: INFO networking_nsxv3.common.synchronization [None req-cc47810c-57ed-45d0-b448-9b3d5ac9b117 None None] Enqueued Resource ID: 5d961f82-ae26-43d0-8bbf-b1c6f9690e14 with Priority: HIGHEST for action port [ 921.026029] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d961f82-ae26-43d0-8bbf-b1c6f9690e14 with Priority: HIGHEST for action port [ 921.026807] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d961f82-ae26-43d0-8bbf-b1c6f9690e14 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.026807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d961f82-ae26-43d0-8bbf-b1c6f9690e14" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.026807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d961f82-ae26-43d0-8bbf-b1c6f9690e14" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.026989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d961f82-ae26-43d0-8bbf-b1c6f9690e14" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.026989] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d961f82-ae26-43d0-8bbf-b1c6f9690e14',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.102894] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.103047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.103761] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e1e18cc-d04a-4d27-86cd-4322e132974b with status ACTIVE [ 921.103761] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.103761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.103761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.103761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.103974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.104016] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.104106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.104171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.104318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.104397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.104584] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.104673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.104730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.104863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.104933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.105029] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e1e18cc-d04a-4d27-86cd-4322e132974b is going to be updated. [ 921.128288] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.128419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.128486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.128694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.128820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.128977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e1e18cc-d04a-4d27-86cd-4322e132974b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.208713] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.209198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.209446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.209736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.209867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.209975] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 is going to be updated. [ 921.250495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.250801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.250801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.250905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.251056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.260319] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: IN_PROGRESS for 2s [ 921.532339] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d961f82-ae26-43d0-8bbf-b1c6f9690e14 [ 921.532609] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.532731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.532797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.533348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.533597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.533740] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d961f82-ae26-43d0-8bbf-b1c6f9690e14 already deleted. [ 921.534478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d961f82-ae26-43d0-8bbf-b1c6f9690e14" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.128111] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 922.128111] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 deletion is rescheduled due to dependency. [ 922.128111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.237368] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 922.237368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.237981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.237981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.238064] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.238147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.238238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.238397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.238548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.238598] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.342524] env[65788]: INFO networking_nsxv3.common.synchronization [None req-21e2739c-f107-4144-a401-4a68ca3e8728 None None] Enqueued Resource ID: 64fa238c-abe3-48b8-9db0-de595d9e10c4 with Priority: HIGHEST for action port [ 922.342812] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64fa238c-abe3-48b8-9db0-de595d9e10c4 with Priority: HIGHEST for action port [ 922.343450] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-64fa238c-abe3-48b8-9db0-de595d9e10c4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.343450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64fa238c-abe3-48b8-9db0-de595d9e10c4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.343450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64fa238c-abe3-48b8-9db0-de595d9e10c4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.343787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64fa238c-abe3-48b8-9db0-de595d9e10c4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.343787] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64fa238c-abe3-48b8-9db0-de595d9e10c4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.461138] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 in Status: SUCCESS [ 922.461652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.462469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.462857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.463222] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.463580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.463707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.464013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.464226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.464432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.464632] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.742506] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.847520] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64fa238c-abe3-48b8-9db0-de595d9e10c4 [ 922.847928] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.847993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.848088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.850949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.851257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.851356] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64fa238c-abe3-48b8-9db0-de595d9e10c4 already deleted. [ 922.851356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64fa238c-abe3-48b8-9db0-de595d9e10c4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.969018] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.245754] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.271713] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: SUCCESS [ 923.271981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.272580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.272848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.273120] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.273268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.273351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.273567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.273672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.273783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.274144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.274228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.276019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.276019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.276019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.276019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.276019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.276019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.276019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.276019] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.470141] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d22e7a7e-27b7-45b2-ac98-bd568f361a92: rpc.has_security_group_logging(os_id): False [ 923.492021] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.492021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.492021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.492245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.492291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.492589] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.492699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.492761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.492917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.492987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.493083] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 is going to be created. [ 923.559243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.559455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.559525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.559865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.560062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.580201] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 in Status: IN_PROGRESS for 2s [ 923.751689] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.751689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.751689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.751689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.751689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.751689] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 923.778157] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30: rpc.has_security_group_logging(os_id): False [ 923.789212] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.789390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.789447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.789679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.789926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.812210] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 923.816304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.816832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.816832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.817032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.817147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.817418] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.817534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.817595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.817766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.817844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.818063] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.818156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.818264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.818352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.818433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.818623] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.818764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.818764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.818896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.818966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.823046] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 is going to be created. [ 923.917905] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.917905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.917905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.917905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.917905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.933341] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: IN_PROGRESS for 2s [ 924.920992] env[65788]: INFO networking_nsxv3.common.synchronization [None req-115fe6b0-9f2b-4443-a28f-a2afdb6ae8f5 None None] Enqueued Resource ID: 7900b8b1-244a-4d11-b94b-8521c0a457c0 with Priority: HIGHEST for action port [ 924.921751] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7900b8b1-244a-4d11-b94b-8521c0a457c0 with Priority: HIGHEST for action port [ 924.924125] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7900b8b1-244a-4d11-b94b-8521c0a457c0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.925869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7900b8b1-244a-4d11-b94b-8521c0a457c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.925869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7900b8b1-244a-4d11-b94b-8521c0a457c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.925869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7900b8b1-244a-4d11-b94b-8521c0a457c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.925869] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7900b8b1-244a-4d11-b94b-8521c0a457c0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.427384] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7900b8b1-244a-4d11-b94b-8521c0a457c0 [ 925.428288] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.428288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.428288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.428288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.428592] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.428592] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7900b8b1-244a-4d11-b94b-8521c0a457c0 already deleted. [ 925.428680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7900b8b1-244a-4d11-b94b-8521c0a457c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.598258] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 in Status: SUCCESS [ 925.598316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.828062] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 925.828062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.828062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.828062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.828062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.828062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.828367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.828409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.828774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.828774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.828774] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.949691] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: SUCCESS [ 925.949986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.950249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.950541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.950665] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.332754] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.332976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.333073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.333552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.333552] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.333552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.333719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.333861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.333903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.334012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.334197] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.334322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.334354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.334490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.334629] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.334725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.334781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.334915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.334994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.335085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.335211] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.454326] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.454519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.454610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.454946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.455160] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.455364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.455434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.455605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.455690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.455781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.455873] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.753373] env[65788]: INFO networking_nsxv3.common.synchronization [req-972cd247-7841-496e-b5cc-19dc49838031 req-8c63229f-bb0b-4afd-a63c-503c8c0f96e1 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 926.754730] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 926.754730] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.754730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.754730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.754947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.755059] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.755202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.755260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.755500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.755600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.755722] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.840549] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1: rpc.has_security_group_logging(os_id): False [ 926.860324] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.860324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.860582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.860629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.860865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.861175] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.861308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.861537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.861604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.861641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.861830] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.862538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.862538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.862538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.862538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.862538] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.862538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.862538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.863025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.863025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.863025] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 926.939204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.939204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.939204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.939204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.939204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.958555] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.958892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.958892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.959156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.959392] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.959537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.959599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.959867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.959991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.960180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.960340] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.960439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.960555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.960814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.961113] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.961251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.961319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.961499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.961600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.961831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.961999] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.966126] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 927.229715] env[65788]: INFO networking_nsxv3.common.synchronization [req-5320c14e-a05b-4f11-976a-f3a1b186c312 req-1c2459e7-7558-4dfa-b1ba-68433abbef98 tempest-MigrationsAdminTest-390226756 tempest-MigrationsAdminTest-390226756-project-member] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 927.230286] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGHEST for action security_group_members [ 927.230667] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.231033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.231033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.231206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.231206] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.231318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.231367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.231662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.231662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.231662] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.258711] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.258711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.258711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.258711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.258711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.258982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.258982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.258982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.259199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.259240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.259314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 927.289204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.289452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.289533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.289848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.290096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.299866] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 927.465623] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30: rpc.has_security_group_logging(os_id): False [ 927.484473] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.484734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.484839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.485081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.485177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.485425] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.485486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.485556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.485770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.485855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.486101] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.486191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.486235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.486397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.486475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.487736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.487736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.487736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.487736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.487736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.487736] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 is going to be updated. [ 927.532310] env[65788]: INFO networking_nsxv3.common.synchronization [req-759a9123-13c7-4000-b711-cdbd76b3af6f req-84434db5-c9bd-472f-a986-6ae6aceeb939 tempest-ServerPasswordTestJSON-417894140 tempest-ServerPasswordTestJSON-417894140-project-member] Enqueued Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_members [ 927.533085] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_members [ 927.533442] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.535971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.536127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.536439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.536678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.536816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.536916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.537209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.537274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.537396] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.577683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.578024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.578024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.578220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.578307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.593080] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: IN_PROGRESS for 2s [ 927.735857] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.736066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.736111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.736308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.768216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.768216] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.768216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.768216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.768216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.768216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.768216] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be updated. [ 927.801121] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.801303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.801376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.801584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.801725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.812341] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: IN_PROGRESS for 2s [ 928.040615] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.041104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.041104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.041104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.041478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.041478] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.041478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.041478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.041797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.041797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.041886] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 already deleted. [ 928.042030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.107272] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.107448] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-93" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.107555] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-93" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.107904] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-93" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.108519] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.108677] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.108749] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.108972] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.109358] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.109358] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.109519] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.109519] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.109626] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.109721] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.109822] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.109945] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.136097] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.136462] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 928.136774] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.136966] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-93" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.137337] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-207cca46-06d6-492c-b524-f751dba7dcb0 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.137759] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.137957] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.138338] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.138538] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('207cca46-06d6-492c-b524-f751dba7dcb0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.426082] env[65788]: INFO networking_nsxv3.common.synchronization [None req-4b758650-ce98-4ec0-8412-7df83661da9a None None] Enqueued Resource ID: 9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5 with Priority: HIGHEST for action port [ 928.426301] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5 with Priority: HIGHEST for action port [ 928.426591] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.426722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.426781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.427066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.427143] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.641974] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.642252] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.642381] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.642781] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.642934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.643133] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 207cca46-06d6-492c-b524-f751dba7dcb0 not found, creating... [ 928.643560] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.643752] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.643871] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.644141] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.644354] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.644669] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.644852] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.644971] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.645216] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.645354] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.645494] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 207cca46-06d6-492c-b524-f751dba7dcb0 is going to be created. [ 928.679107] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.679350] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.679462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.679743] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.679971] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.680242] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.929379] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5 [ 928.932049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.932049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.932049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.932049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.932049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.932049] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5 already deleted. [ 928.932049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a2604bf-ff6b-407f-8b15-0eb9c0fc23e5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.980652] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 928.981356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.308737] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 929.309017] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 deletion is rescheduled due to dependency. [ 929.309201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.400611] env[65788]: INFO networking_nsxv3.common.synchronization [req-759a9123-13c7-4000-b711-cdbd76b3af6f req-fc335008-2f25-4efa-bdfa-d78bb7a0e597 service nova] Enqueued Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_rules [ 929.400806] env[65788]: INFO networking_nsxv3.common.synchronization [req-759a9123-13c7-4000-b711-cdbd76b3af6f req-fc335008-2f25-4efa-bdfa-d78bb7a0e597 service nova] Enqueued Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_members [ 929.400944] env[65788]: INFO networking_nsxv3.common.synchronization [req-759a9123-13c7-4000-b711-cdbd76b3af6f req-fc335008-2f25-4efa-bdfa-d78bb7a0e597 service nova] Enqueued Resource ID: 207cca46-06d6-492c-b524-f751dba7dcb0 with Priority: HIGHEST for action port [ 929.401501] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_rules [ 929.401640] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_members [ 929.401736] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 207cca46-06d6-492c-b524-f751dba7dcb0 with Priority: HIGHEST for action port [ 929.402017] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.402151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.402195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.402476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.403725] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.403906] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.404036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.404068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.404304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.404423] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.404469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.404607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.405846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.405947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.406060] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.409833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-207cca46-06d6-492c-b524-f751dba7dcb0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.409833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.409833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.410554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.410639] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('207cca46-06d6-492c-b524-f751dba7dcb0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.608284] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: SUCCESS [ 929.608284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.702191] env[65788]: INFO networking_nsxv3.common.synchronization [req-f55494c6-45f1-4924-9516-3f176a9497a9 req-e3c78828-70a3-4288-ba52-5ee88a540e40 tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 929.702627] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 929.703166] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.704708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.704708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.704708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.704708] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.705027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.705027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.705122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.705168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.705246] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.823071] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 in Status: SUCCESS [ 929.823261] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 deletion is rescheduled due to dependency. [ 929.823370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.912959] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.914167] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.914274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.914439] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 207cca46-06d6-492c-b524-f751dba7dcb0 with status ACTIVE [ 929.914601] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.914708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.914779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.914989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.915087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.916921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.916921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.916921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.916921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.916921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.916921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.916921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.916921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.916921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.918102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.918221] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 207cca46-06d6-492c-b524-f751dba7dcb0 is going to be updated. [ 929.941545] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.941723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.941761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.942087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.942229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.942498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-207cca46-06d6-492c-b524-f751dba7dcb0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.157793] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.158124] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.158255] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.158513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.158840] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.158998] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.159264] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.159510] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.159746] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.159967] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.160127] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.160269] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.160408] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.160546] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.160679] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.160862] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.180327] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.180528] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.180650] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.180825] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-590" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.181177] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.181361] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.181503] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.181785] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.181921] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.208034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.208034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.208177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.208495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.208495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.208680] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.208805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.208869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.209074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.209182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.209281] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 930.245187] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.245451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.245536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.245740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.245893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.259716] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 930.420407] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.684228] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.684793] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.684793] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.685177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.685177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.685238] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 not found, creating... [ 930.685658] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.685757] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.685888] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.686133] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.686273] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.686565] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.686715] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.686934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.687121] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.687279] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.687423] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 is going to be created. [ 930.704805] env[65788]: INFO networking_nsxv3.common.synchronization [None req-022af1c8-d8f7-482c-a7a3-9a444d21bd6a None None] Enqueued Resource ID: 47fd36af-2e88-4a13-adde-44eb5ebcdb8b with Priority: HIGHEST for action port [ 930.705393] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47fd36af-2e88-4a13-adde-44eb5ebcdb8b with Priority: HIGHEST for action port [ 930.705710] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-47fd36af-2e88-4a13-adde-44eb5ebcdb8b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.705845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47fd36af-2e88-4a13-adde-44eb5ebcdb8b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.705904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47fd36af-2e88-4a13-adde-44eb5ebcdb8b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.706161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47fd36af-2e88-4a13-adde-44eb5ebcdb8b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.706246] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47fd36af-2e88-4a13-adde-44eb5ebcdb8b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.721021] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.721683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.721683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.721862] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.722016] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.722337] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.923974] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.924257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.924257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.924438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.924544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.924694] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 is going to be created. [ 930.960046] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.960046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.960299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.960333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.963499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.977828] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 in Status: UNINITIALIZED for 2s [ 931.208622] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47fd36af-2e88-4a13-adde-44eb5ebcdb8b [ 931.208622] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.208622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.208622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.208622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.208886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.208886] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47fd36af-2e88-4a13-adde-44eb5ebcdb8b already deleted. [ 931.208949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47fd36af-2e88-4a13-adde-44eb5ebcdb8b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.423141] env[65788]: INFO networking_nsxv3.common.synchronization [req-f55494c6-45f1-4924-9516-3f176a9497a9 req-5f72947b-b65c-4470-9992-59c7da2d59b8 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 931.423141] env[65788]: INFO networking_nsxv3.common.synchronization [req-f55494c6-45f1-4924-9516-3f176a9497a9 req-5f72947b-b65c-4470-9992-59c7da2d59b8 service nova] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 931.423496] env[65788]: INFO networking_nsxv3.common.synchronization [req-f55494c6-45f1-4924-9516-3f176a9497a9 req-5f72947b-b65c-4470-9992-59c7da2d59b8 service nova] Enqueued Resource ID: 1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 with Priority: HIGHEST for action port [ 931.423752] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_rules [ 931.423885] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 931.423979] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 with Priority: HIGHEST for action port [ 931.424529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.424672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.424710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.424932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.425038] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.425864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.425974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.426162] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.426265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.426327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.426482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.426558] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.931678] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 with status ACTIVE [ 931.931678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.931678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.931678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.931678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.931678] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5 is going to be updated. [ 931.934496] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.934496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.956500] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.957295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.957295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.957954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.957954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.957954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be1f0d1-7f21-4da2-9755-5ce1cebd4ed5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.270783] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 932.270974] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 deletion is rescheduled due to dependency. [ 932.271106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.271362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.271676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.271957] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.272172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.272288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.272603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.272744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.272894] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.459321] env[65788]: INFO networking_nsxv3.common.synchronization [req-a3c92014-a1c4-44e9-a06f-cf1b65808c61 req-00a6e1a8-1fa4-428b-9a0c-384f99c5404e tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 932.459919] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 932.460281] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.460465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.460732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.460984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.461229] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.461378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.461486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.461632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.461728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.461837] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.777339] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.964891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.965134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.965134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.965346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.965437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.965695] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.965881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.965881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.966228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.966228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.966228] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 932.988592] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 in Status: SUCCESS [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.990508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.990508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.990508] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.007496] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.007642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.007713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.008137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.010264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.017720] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 933.284133] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.498314] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.498314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.498314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.498314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.498853] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.498853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.498933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.500043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.500043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.500043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.500043] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.500043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.502073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.502326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.502567] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.502727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.502839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.503106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.503221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.504262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.504262] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.791860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.792274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.792581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.792876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.793117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.793350] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 933.845415] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.845556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.845683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.845834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.845970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.856246] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 934.007925] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adb68513-ddb5-44a7-8610-69e7dc83ba07: rpc.has_security_group_logging(os_id): False [ 934.032554] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.032735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.032979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.033182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.033318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.033484] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.033603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.033759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.033848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.033983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.034291] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.034291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.034453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.034481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.034874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.034874] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.035121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.035121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.035121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.035327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.035327] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 is going to be created. [ 934.125680] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.125911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.125964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.126197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.126429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.141032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 in Status: IN_PROGRESS for 2s [ 934.146161] env[65788]: INFO networking_nsxv3.common.synchronization [req-56266497-9a40-4b12-9ce2-4634bba79243 req-ac39aa99-7bea-4819-b9f6-881b72b4f86a tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_members [ 934.146808] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGHEST for action security_group_members [ 934.147151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.147269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.147649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.147649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.147748] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.147822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.147822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.147977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.148086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.148180] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.655433] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.655433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.655433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.655433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.679684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.680287] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.680540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.680656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.682012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.682012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.682012] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 is going to be updated. [ 934.731904] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.732090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.732136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.732409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.732541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.744203] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: IN_PROGRESS for 2s [ 934.837326] env[65788]: INFO networking_nsxv3.common.synchronization [req-a0eeaeaa-217a-4a8a-89d1-8d63933a3f20 req-e3d07792-5916-413e-af52-99ef66741d99 tempest-ServersTestFqdnHostnames-1416237530 tempest-ServersTestFqdnHostnames-1416237530-project-member] Enqueued Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_members [ 934.837801] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGHEST for action security_group_members [ 934.838238] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.838371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.838590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.838770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.839020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.839181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.839311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.839567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.839749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.839904] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.912060] env[65788]: INFO networking_nsxv3.common.synchronization [req-119c3f55-fadd-4771-aabb-7a31fc40e670 req-0f2618f2-7bad-4fee-b8e4-8fae34c923d0 tempest-ServerAddressesNegativeTestJSON-1215978525 tempest-ServerAddressesNegativeTestJSON-1215978525-project-member] Enqueued Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_members [ 934.912652] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_members [ 934.912959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d96e629-2a5d-4253-97dc-c6a3cd034461 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.913214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.913294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.913585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.913748] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.913869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.913906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.914101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.914157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.914232] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.030699] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 935.030865] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 935.031548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.342194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.342388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.342388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.342724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.342863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.343093] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.343093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.343203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.343351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.343381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.343451] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 is going to be updated. [ 935.379351] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.379822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.379907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.380144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.380292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.391810] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 793b8c66-424d-4744-801e-0d08e132ad00 in Status: IN_PROGRESS for 2s [ 935.418301] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.418583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.418673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.418940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.419153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.419408] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.419613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.419705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.419881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.419986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.420183] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 already deleted. [ 935.420376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.558872] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.559158] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-281" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.559315] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-281" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.559811] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-281" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.560185] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.560397] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.560572] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.560895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.561086] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.561528] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.561689] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.561843] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.561979] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.562149] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.562372] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.562636] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.586553] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.586896] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.587124] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.587353] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-281" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.587787] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-fa02b12a-17f7-4522-9e2f-c012cef93bba taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.588043] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.588160] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.588475] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.588608] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa02b12a-17f7-4522-9e2f-c012cef93bba',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.869619] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 935.869619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.870096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.870096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.870222] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.870390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.870465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.870628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.870713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.870842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.870906] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.095093] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.095327] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.095410] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.095960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.095960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.096098] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port fa02b12a-17f7-4522-9e2f-c012cef93bba not found, creating... [ 936.097418] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.097418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.097418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.097418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.097418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.097418] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.097418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.097942] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.097942] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.099665] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.099665] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: fa02b12a-17f7-4522-9e2f-c012cef93bba is going to be created. [ 936.124291] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.124773] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.125025] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.125402] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.125729] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.126216] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.154428] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 in Status: SUCCESS [ 936.154616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.375523] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.375523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.375523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.375523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.375523] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.375523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.375523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.375523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.375523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.377860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.378303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.378425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.378569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.378959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.379227] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.379227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.379438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.379512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.379541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.379638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.379638] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.756344] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 in Status: SUCCESS [ 936.756522] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 deletion is rescheduled due to dependency. [ 936.757495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.885942] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482328ee-c8ae-447e-af1f-c321cd088282: rpc.has_security_group_logging(os_id): False [ 936.907303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.907460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.907572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.907898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.908050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.908323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.908472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.908601] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.908779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.908872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.909096] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.909222] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.909273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.909413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.909642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.909729] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.910653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.910653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.910653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.910653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.910653] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 936.956153] env[65788]: INFO networking_nsxv3.common.synchronization [req-119c3f55-fadd-4771-aabb-7a31fc40e670 req-63b2c1ab-5a4e-421c-bfa9-4e6e4997e50c service nova] Enqueued Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_rules [ 936.956366] env[65788]: INFO networking_nsxv3.common.synchronization [req-119c3f55-fadd-4771-aabb-7a31fc40e670 req-63b2c1ab-5a4e-421c-bfa9-4e6e4997e50c service nova] Enqueued Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_members [ 936.956795] env[65788]: INFO networking_nsxv3.common.synchronization [req-119c3f55-fadd-4771-aabb-7a31fc40e670 req-63b2c1ab-5a4e-421c-bfa9-4e6e4997e50c service nova] Enqueued Resource ID: fa02b12a-17f7-4522-9e2f-c012cef93bba with Priority: HIGHEST for action port [ 936.958947] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_rules [ 936.958947] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_members [ 936.958947] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa02b12a-17f7-4522-9e2f-c012cef93bba with Priority: HIGHEST for action port [ 936.959190] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d96e629-2a5d-4253-97dc-c6a3cd034461 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.959335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.959864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.959864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.959864] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.962122] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d96e629-2a5d-4253-97dc-c6a3cd034461 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.962122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.962122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.962122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.962122] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.962122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.962122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.962122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.962444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.962444] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.964631] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa02b12a-17f7-4522-9e2f-c012cef93bba taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.964631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.964631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.964631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.964631] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa02b12a-17f7-4522-9e2f-c012cef93bba',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.989323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.989608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.989712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.989987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.990417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.014514] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 937.404027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 793b8c66-424d-4744-801e-0d08e132ad00 in Status: SUCCESS [ 937.404027] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 deletion is rescheduled due to dependency. [ 937.404027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.468087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d96e629-2a5d-4253-97dc-c6a3cd034461 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.468087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.468087] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa02b12a-17f7-4522-9e2f-c012cef93bba with status ACTIVE [ 937.468087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.468087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.468087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.468087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.468087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.468087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.468894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.469090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.469361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.469669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.469723] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.469901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.469951] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.470454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.470591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.470757] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa02b12a-17f7-4522-9e2f-c012cef93bba is going to be updated. [ 937.472268] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.499112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.499392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.499516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.500172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.500535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa02b12a-17f7-4522-9e2f-c012cef93bba" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.977716] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.481039] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.482907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.482907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.482907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.482907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.482907] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 is going to be created. [ 938.512044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.512044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.512044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.512044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.512044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.524067] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 in Status: UNINITIALIZED for 2s [ 939.038239] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 939.038730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.389119] env[65788]: INFO networking_nsxv3.common.synchronization [req-422088c1-139e-4798-b6fe-62a5ea4513b3 req-7712082c-a166-4c32-8a19-964b2393201a tempest-InstanceActionsTestJSON-1965762885 tempest-InstanceActionsTestJSON-1965762885-project-member] Enqueued Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_members [ 939.389687] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_members [ 939.389977] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.390426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.390426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.390655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.390838] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.390946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.391031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.391204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.391291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.391388] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.893331] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.893623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.893623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.894313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.894313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.894313] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.894313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.894577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.894577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.894577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.894694] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb83c2-5239-4c9a-ba59-1206501032bb already deleted. [ 939.894731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.945945] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.946163] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-750" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.946287] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-750" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.946625] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-750" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.946943] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.947134] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.947271] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.947531] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.947708] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.947983] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.948137] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.948248] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.948352] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.948462] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.948567] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.949098] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.126673] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.127207] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.178 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.127207] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.127207] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-750" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.127511] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-be08539a-4a13-4533-bf4d-354a91ce263d taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.127683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.127799] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.128153] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.128292] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be08539a-4a13-4533-bf4d-354a91ce263d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.535536] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 in Status: SUCCESS [ 940.536268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.536268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.536458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.536610] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.536827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.536942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.537177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.537296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.538029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.538029] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.631486] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.632093] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.632317] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.632890] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.633131] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.633300] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port be08539a-4a13-4533-bf4d-354a91ce263d not found, creating... [ 940.633665] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.633865] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.634022] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.634276] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.634702] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.635058] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.635231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.635511] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.635770] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.635912] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.636062] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: be08539a-4a13-4533-bf4d-354a91ce263d is going to be created. [ 940.650245] env[65788]: INFO networking_nsxv3.common.synchronization [None req-4b326695-79f3-417f-b2be-fad4a95f41cb None None] Enqueued Resource ID: 3cac3627-0f25-4874-9cff-2dcd25ab35d3 with Priority: HIGHEST for action port [ 940.651052] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cac3627-0f25-4874-9cff-2dcd25ab35d3 with Priority: HIGHEST for action port [ 940.651262] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cac3627-0f25-4874-9cff-2dcd25ab35d3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.651379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cac3627-0f25-4874-9cff-2dcd25ab35d3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.651441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cac3627-0f25-4874-9cff-2dcd25ab35d3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.651706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cac3627-0f25-4874-9cff-2dcd25ab35d3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.651783] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cac3627-0f25-4874-9cff-2dcd25ab35d3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.668735] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.668979] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.669120] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.669403] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.669663] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.669910] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.040071] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d96e629-2a5d-4253-97dc-c6a3cd034461 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.040277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.041169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.041445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.041703] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.041834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.041901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.042126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.042261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.042319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.042511] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d96e629-2a5d-4253-97dc-c6a3cd034461 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.042661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.042734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.043173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.043344] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.043512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.043512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.044128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.044128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.044128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.044334] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.155071] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cac3627-0f25-4874-9cff-2dcd25ab35d3 [ 941.155364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.155364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.155364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.156853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.156853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.156853] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cac3627-0f25-4874-9cff-2dcd25ab35d3 already deleted. [ 941.156853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cac3627-0f25-4874-9cff-2dcd25ab35d3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.466571] env[65788]: INFO networking_nsxv3.common.synchronization [req-422088c1-139e-4798-b6fe-62a5ea4513b3 req-8a08f96a-bc1c-46f2-90bf-9d0992d4f17d service nova] Enqueued Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_rules [ 941.466836] env[65788]: INFO networking_nsxv3.common.synchronization [req-422088c1-139e-4798-b6fe-62a5ea4513b3 req-8a08f96a-bc1c-46f2-90bf-9d0992d4f17d service nova] Enqueued Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_members [ 941.466935] env[65788]: INFO networking_nsxv3.common.synchronization [req-422088c1-139e-4798-b6fe-62a5ea4513b3 req-8a08f96a-bc1c-46f2-90bf-9d0992d4f17d service nova] Enqueued Resource ID: be08539a-4a13-4533-bf4d-354a91ce263d with Priority: HIGHEST for action port [ 941.467564] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_rules [ 941.468012] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_members [ 941.468012] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be08539a-4a13-4533-bf4d-354a91ce263d with Priority: HIGHEST for action port [ 941.472938] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.472938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.472938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.473139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.473578] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.474331] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.474452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.474530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.474989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.474989] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.474989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.475298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.475298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.475298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.475399] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.477529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-be08539a-4a13-4533-bf4d-354a91ce263d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.477684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.477743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.477869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.478048] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be08539a-4a13-4533-bf4d-354a91ce263d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.546658] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d96e629-2a5d-4253-97dc-c6a3cd034461: rpc.has_security_group_logging(os_id): False [ 941.569633] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.570054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.570160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.570375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.570464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.570690] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.570796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.570859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.571016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.571126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.571382] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.571496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.571563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.571733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.571809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.572029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.572129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.572189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.572330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.572404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.572533] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 is going to be created. [ 941.644520] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.644520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.644520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.644520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.644520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.656671] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 in Status: IN_PROGRESS for 2s [ 941.927265] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-7e68aeb0-8b1e-4031-8e8f-c2ce1581dba2 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 941.927559] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 941.927850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.927981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.931468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.931468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.932886] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.933025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.933095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.933288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.933400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.933484] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.978371] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.980725] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be08539a-4a13-4533-bf4d-354a91ce263d with status ACTIVE [ 941.980956] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.981101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.981190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.981390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.981481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.982819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.982819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.982819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.982819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.982819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.982819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.983168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.983168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.983259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.983293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.983380] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be08539a-4a13-4533-bf4d-354a91ce263d is going to be updated. [ 941.984786] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.984898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.008240] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.008391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.008443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.009241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.009241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.010183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be08539a-4a13-4533-bf4d-354a91ce263d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.026021] env[65788]: INFO networking_nsxv3.common.synchronization [req-350e9e64-8ca3-4e29-a0a5-a6c8f68d425b req-27b3ff04-ee04-4789-bc62-7cf5c3dfa10e tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_members [ 942.026021] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGHEST for action security_group_members [ 942.026463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.026597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.026657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.026897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.027359] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.027469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.027521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.028136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.028237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.028335] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.436764] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.441671] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.441671] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a already deleted. [ 942.441671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.482390] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.536733] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.536733] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.536733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.536733] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 is going to be updated. [ 942.565854] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.567069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.567069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.567069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.567069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.581023] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 in Status: IN_PROGRESS for 2s [ 942.581023] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-ab7ab2db-952d-4fd6-9feb-b4d1b283260a tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 942.582130] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 942.582951] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.583299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.585361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.585361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.585361] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.585361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.585361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.585361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.585361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.585361] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.987274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.987434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.989439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.989439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.989439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.989439] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb83c2-5239-4c9a-ba59-1206501032bb is going to be created. [ 943.007033] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-8f9fa893-2397-43ce-af64-b400d81c4696 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 943.007152] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 943.007477] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.007575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.022626] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.022626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.022626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.022809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.022924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.040719] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb83c2-5239-4c9a-ba59-1206501032bb in Status: UNINITIALIZED for 2s [ 943.087127] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.087475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.087475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.087896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.087896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.088197] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.088436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.088499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.089104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.089104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.089104] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a already deleted. [ 943.089104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.089291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.089720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.089720] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.089924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.089924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.090604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.090722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.090934] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.406097] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.406376] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.406519] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.407454] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.407768] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.407939] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.408075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.408332] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.408494] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.408750] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.408889] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.409105] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.409230] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.409353] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.409459] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.409594] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.418448] env[65788]: INFO networking_nsxv3.common.synchronization [None req-41d1b96e-ee1c-478a-a954-3db72690dd83 tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 943.419269] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 943.419591] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.419719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.419783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.421257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.421357] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.432038] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.432564] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.432642] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.433098] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.433286] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-2a6440e4-feb3-4de4-9906-49be8de4721d taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.433504] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.434283] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.434283] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.434283] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6440e4-feb3-4de4-9906-49be8de4721d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.537073] env[65788]: INFO networking_nsxv3.common.synchronization [None req-56b39231-53c5-4fb7-97fa-16da1527c5f0 tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 943.537351] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 943.539142] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.539142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.594416] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.594416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.594416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.594788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.594861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.595498] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.595498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.595498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.595804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.596312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.596482] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a already deleted. [ 943.596626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.670639] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 in Status: SUCCESS [ 943.670972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.739873] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7dbcf970-c826-4bc1-b7aa-e559aa4cef88 None None] Enqueued Resource ID: 4d579117-e392-45b2-affd-52b8ada5946b with Priority: HIGHEST for action port [ 943.740756] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d579117-e392-45b2-affd-52b8ada5946b with Priority: HIGHEST for action port [ 943.742291] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d579117-e392-45b2-affd-52b8ada5946b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.742291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d579117-e392-45b2-affd-52b8ada5946b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.742291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d579117-e392-45b2-affd-52b8ada5946b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.742291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d579117-e392-45b2-affd-52b8ada5946b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.742291] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d579117-e392-45b2-affd-52b8ada5946b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.937281] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.937547] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.937707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.938055] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.938320] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.938688] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 2a6440e4-feb3-4de4-9906-49be8de4721d not found, creating... [ 943.940177] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.940650] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.940972] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.941349] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.941543] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.941970] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.942214] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.942816] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.943197] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.943805] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.944123] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 2a6440e4-feb3-4de4-9906-49be8de4721d is going to be created. [ 943.948786] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.949655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.949851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.950159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.950265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.950427] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec already deleted. [ 943.950641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.950915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.951317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.951449] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.000220] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.001692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.001692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.001692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.002035] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.002388] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.245356] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d579117-e392-45b2-affd-52b8ada5946b [ 944.245356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.245565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.245565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.245870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.246535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.246535] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d579117-e392-45b2-affd-52b8ada5946b already deleted. [ 944.246535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d579117-e392-45b2-affd-52b8ada5946b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.483625] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.483840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.483840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.484064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.484155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.484257] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec already deleted. [ 944.484337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.590584] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 in Status: SUCCESS [ 944.591032] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 deletion is rescheduled due to dependency. [ 944.591032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.713982] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-f426c9ef-b7a4-460e-ade2-8d670dfc784c service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 944.714232] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-f426c9ef-b7a4-460e-ade2-8d670dfc784c service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 944.714412] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-f426c9ef-b7a4-460e-ade2-8d670dfc784c service nova] Enqueued Resource ID: 2a6440e4-feb3-4de4-9906-49be8de4721d with Priority: HIGHEST for action port [ 944.715092] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 944.715268] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 944.715395] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a6440e4-feb3-4de4-9906-49be8de4721d with Priority: HIGHEST for action port [ 944.715746] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.715887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.716294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.716383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.716528] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.717713] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.717713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.718193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.718489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.718797] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.719807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.719807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.719807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.719807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.719807] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.721138] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a6440e4-feb3-4de4-9906-49be8de4721d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.722043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.722043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.722043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.722043] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6440e4-feb3-4de4-9906-49be8de4721d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.053670] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb83c2-5239-4c9a-ba59-1206501032bb in Status: SUCCESS [ 945.054068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.054617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.054901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.055190] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.055350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.055509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.055737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.055867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.055985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.056132] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.222053] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.223273] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.223464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.224133] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a6440e4-feb3-4de4-9906-49be8de4721d with status ACTIVE [ 945.224133] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.224133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.224333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.225540] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.225540] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.225540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.226033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.226033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.226033] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a6440e4-feb3-4de4-9906-49be8de4721d is going to be updated. [ 945.252111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.252351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.252351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.252745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.252957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.253233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a6440e4-feb3-4de4-9906-49be8de4721d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.558858] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.559076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.559151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.559424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.559601] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.559724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.559784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.559908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.559992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.560130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.560690] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.560690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.560690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.560842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.560883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.561086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.561142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.561279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.561355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.561440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.561585] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.565991] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.566192] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-128" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.566310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-128" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.566603] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-128" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.567311] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.567483] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.567602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.567823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.567961] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.568317] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.568389] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.568485] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.568589] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.568694] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.568842] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.568996] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.593180] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.593180] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.593563] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.593563] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-128" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.593745] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-08ba0484-2133-4e73-a916-96b2b20e46c5 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.593932] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.594064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.594406] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.594542] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ba0484-2133-4e73-a916-96b2b20e46c5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.724858] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.065060] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbcb83c2-5239-4c9a-ba59-1206501032bb: rpc.has_security_group_logging(os_id): False [ 946.093330] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.093591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.093591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.093805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.093908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.094117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.094322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.094393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.094560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.094640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.095032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.095032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.095032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.095291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.095291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.095427] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.095508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.095578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.095720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.095786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.095886] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbcb83c2-5239-4c9a-ba59-1206501032bb is going to be created. [ 946.097628] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.097870] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.097996] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.098236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.098375] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.098520] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 08ba0484-2133-4e73-a916-96b2b20e46c5 not found, creating... [ 946.098773] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.098940] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.099082] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.099297] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.099432] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.099727] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.099904] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.100011] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.100223] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.100373] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.100534] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 08ba0484-2133-4e73-a916-96b2b20e46c5 is going to be created. [ 946.128914] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.129183] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.129270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.129548] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.129803] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.130102] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.218179] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.218362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.218476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.218713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.218999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.227509] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.227664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.227736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.227957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.228059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.228162] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be created. [ 946.233656] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbcb83c2-5239-4c9a-ba59-1206501032bb in Status: IN_PROGRESS for 2s [ 946.310063] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.310207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.310272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.310566] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.310779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.328673] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: UNINITIALIZED for 2s [ 946.848940] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-6b165374-333e-4d9d-b291-9b6243bf72eb service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 946.849260] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-6b165374-333e-4d9d-b291-9b6243bf72eb service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 946.849411] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-6b165374-333e-4d9d-b291-9b6243bf72eb service nova] Enqueued Resource ID: 08ba0484-2133-4e73-a916-96b2b20e46c5 with Priority: HIGHEST for action port [ 946.849915] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 946.850082] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 946.850199] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ba0484-2133-4e73-a916-96b2b20e46c5 with Priority: HIGHEST for action port [ 946.850526] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.850642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.850850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.850958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.851162] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-08ba0484-2133-4e73-a916-96b2b20e46c5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.851761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.851842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.852093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.852184] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ba0484-2133-4e73-a916-96b2b20e46c5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.354869] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08ba0484-2133-4e73-a916-96b2b20e46c5 with status ACTIVE [ 947.355185] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.355335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.355495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.355674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.355789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.356074] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.356171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.356235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.356419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.356499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.356751] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.356832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.356869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.357015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.357100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.357199] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08ba0484-2133-4e73-a916-96b2b20e46c5 is going to be updated. [ 947.381972] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.382204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.382250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.382453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.382651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.382817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08ba0484-2133-4e73-a916-96b2b20e46c5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.672911] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.673186] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.673357] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.673724] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.674201] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.674435] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.674595] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.674934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.675146] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.675423] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.675614] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.675759] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.675886] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.676109] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.676242] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.676433] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.697997] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.698257] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.698458] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.698742] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-809" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.699271] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-95dcc0e6-2045-46e5-928d-b23591f86109 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.699540] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.699732] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.700181] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.700421] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95dcc0e6-2045-46e5-928d-b23591f86109',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.202928] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.203371] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.203371] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.203688] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.203865] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.204085] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 95dcc0e6-2045-46e5-928d-b23591f86109 not found, creating... [ 948.204456] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.204664] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.204838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.205122] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.205420] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.205815] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.206045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.206253] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.206503] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.206694] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.206867] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 95dcc0e6-2045-46e5-928d-b23591f86109 is going to be created. [ 948.230318] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.230606] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.230709] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.231545] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.231630] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.232682] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.249739] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbcb83c2-5239-4c9a-ba59-1206501032bb in Status: SUCCESS [ 948.249980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.341621] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 948.341856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.342058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.342288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.342568] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.342753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.342867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.343128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.343265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.343459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.343630] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.344564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.344741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.344920] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.345037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.345107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.345245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.345341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.345429] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.849586] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.849841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.850150] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.019564] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-555280d8-0cd4-45c7-978c-6c56cb88c15e service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 949.019564] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-555280d8-0cd4-45c7-978c-6c56cb88c15e service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 949.019564] env[65788]: INFO networking_nsxv3.common.synchronization [req-95888e70-df6c-4f7b-b3d3-1583eef8e90b req-555280d8-0cd4-45c7-978c-6c56cb88c15e service nova] Enqueued Resource ID: 95dcc0e6-2045-46e5-928d-b23591f86109 with Priority: HIGHEST for action port [ 949.019925] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 949.020281] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 949.020600] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dcc0e6-2045-46e5-928d-b23591f86109 with Priority: HIGHEST for action port [ 949.020762] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.021427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.021761] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.021918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.022146] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-95dcc0e6-2045-46e5-928d-b23591f86109 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.022722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.022722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.022722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.022722] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95dcc0e6-2045-46e5-928d-b23591f86109',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.352879] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.525594] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95dcc0e6-2045-46e5-928d-b23591f86109 with status ACTIVE [ 949.525937] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.526050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.526050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.526265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.526355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.526553] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.526629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.526740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.526841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.526933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.527153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.527276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.527276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.527398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.527470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.527554] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95dcc0e6-2045-46e5-928d-b23591f86109 is going to be updated. [ 949.550719] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.550863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.550925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.551155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.551290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.551446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95dcc0e6-2045-46e5-928d-b23591f86109" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.855645] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.855945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.855945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.856168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.856337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.856448] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 949.892092] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.892310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.892364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.892570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.892728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.903394] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 951.346480] env[65788]: INFO networking_nsxv3.common.synchronization [req-ecaf7415-7634-497a-9362-01fddddd9bcc req-fa7be7fb-8d37-41af-aec0-9cf7dff8fb2d tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 951.347183] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 951.347536] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.347687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.347772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.347998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.348190] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.348308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.348373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.348545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.348653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.348766] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.851942] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.880899] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.881109] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.881227] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.881489] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.881755] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.882915] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.882915] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.882915] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.882915] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.883088] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.883193] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.883305] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.883412] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.883610] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.883735] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.883849] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.912068] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.912068] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.912068] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.912068] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.912068] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-e0b7cd58-c522-4285-af52-f02fca39ef9f taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.912068] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.912068] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.912480] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.912480] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b7cd58-c522-4285-af52-f02fca39ef9f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.914735] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 951.914961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.915469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.915707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.915911] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.916027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.916093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.916341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.916388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.916480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.916596] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.916730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.916790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.917433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.917433] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.917433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.917433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.917433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.917645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.917645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.917705] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.919822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.920101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.920342] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.920503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.920589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.920834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.920929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.921107] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.354780] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.424462] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.424462] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port e0b7cd58-c522-4285-af52-f02fca39ef9f not found, creating... [ 952.424462] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.424462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.424840] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.424840] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.424840] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.425257] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.425508] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.425748] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: e0b7cd58-c522-4285-af52-f02fca39ef9f is going to be created. [ 952.427478] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c86f5e-5e15-4193-915e-454c2a0bcd6a: rpc.has_security_group_logging(os_id): False [ 952.428863] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.452068] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.452068] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.452068] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.452068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.452702] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.452702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.452702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.452702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.452702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.452702] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be created. [ 952.459240] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.459240] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.459240] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.459240] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.459240] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.459240] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.549880] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.549880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.549880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.549880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.549880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.561585] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 952.857782] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.857949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.858035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.858260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.858354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.858462] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 952.891570] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.892106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.892106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.892106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.892239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.904311] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 952.932366] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.246126] env[65788]: INFO networking_nsxv3.common.synchronization [req-ecaf7415-7634-497a-9362-01fddddd9bcc req-a6cad98c-756f-4f96-b3f9-4c2db46337ea service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 953.247031] env[65788]: INFO networking_nsxv3.common.synchronization [req-ecaf7415-7634-497a-9362-01fddddd9bcc req-a6cad98c-756f-4f96-b3f9-4c2db46337ea service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 953.247031] env[65788]: INFO networking_nsxv3.common.synchronization [req-ecaf7415-7634-497a-9362-01fddddd9bcc req-a6cad98c-756f-4f96-b3f9-4c2db46337ea service nova] Enqueued Resource ID: e0b7cd58-c522-4285-af52-f02fca39ef9f with Priority: HIGHEST for action port [ 953.247684] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 953.247875] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 953.248043] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0b7cd58-c522-4285-af52-f02fca39ef9f with Priority: HIGHEST for action port [ 953.248560] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.248676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.248787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.249076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.249226] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.250376] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.250552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.250813] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0b7cd58-c522-4285-af52-f02fca39ef9f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.250952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.251061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.251318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.251423] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b7cd58-c522-4285-af52-f02fca39ef9f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.434888] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.435373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.435373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.435373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.435373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.435501] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 953.470727] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.470971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.470971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.471252] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.471371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.482411] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 953.569108] env[65788]: INFO networking_nsxv3.common.synchronization [req-276f6da1-7648-4537-8a15-ff9cb654f35f req-8c971213-1e64-4d1e-92f5-555f50bfd2bc tempest-ServerPasswordTestJSON-417894140 tempest-ServerPasswordTestJSON-417894140-project-member] Enqueued Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_members [ 953.569108] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGHEST for action security_group_members [ 953.569440] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.569546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.569615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.569839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.569998] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.570144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.570213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.570511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.570511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.570665] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.602410] env[65788]: INFO networking_nsxv3.common.synchronization [None req-37e3d4da-35a7-4322-8b19-0ad49035bd53 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_rules [ 953.603219] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_rules [ 953.606410] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.606410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.606410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.606410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.606410] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.753873] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0b7cd58-c522-4285-af52-f02fca39ef9f with status ACTIVE [ 953.754162] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.754334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.754448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.754725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.754897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.755052] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.755202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.755299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.755426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.755805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.755805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.755994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.755994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.756145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.756179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.756304] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0b7cd58-c522-4285-af52-f02fca39ef9f is going to be updated. [ 953.757596] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.757716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.780390] env[65788]: INFO networking_nsxv3.common.synchronization [None req-614cfe4e-19fd-4c91-9e2f-99ceb941c29a tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_rules [ 953.780959] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_rules [ 953.781378] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.781454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.790578] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.790836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.790836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.791053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.791193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.791360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0b7cd58-c522-4285-af52-f02fca39ef9f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.074347] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.074577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.074689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.075910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.075910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.075910] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.075910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.075910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.075910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.076236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.076236] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 is going to be updated. [ 954.125782] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.126042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.126121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.126646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.126757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.134266] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.134502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.134636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.134854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.134980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.135127] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 already deleted. [ 954.135245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.135462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.135707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.136298] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.141468] env[65788]: INFO networking_nsxv3.common.synchronization [req-4a6392ac-6e5d-4397-b9c0-5f98c0405536 req-efd144f6-9973-4979-b536-7ea152461b32 tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 954.142455] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 in Status: IN_PROGRESS for 2s [ 954.143973] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 954.143973] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.143973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.143973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.143973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.146515] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.146751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.146869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.147136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.147255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.147382] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.575741] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 954.576223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.576619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.580114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.580279] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.615395] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.615656] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.615796] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.616252] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.616420] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.617268] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.617499] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.617886] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.618078] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.618340] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.618493] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.618638] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.618787] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.619054] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.619110] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.619284] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.640707] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.640877] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.641042] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.641271] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.641600] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-72d74464-4066-4d23-8644-35d44817e426 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.641790] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.641955] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.642386] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.642637] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72d74464-4066-4d23-8644-35d44817e426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.655040] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.655040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.655040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.655040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.655040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.655040] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.655040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.655040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.655549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.655549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.655549] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 954.676815] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.677047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.677143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.677441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.677586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.677745] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 already deleted. [ 954.677898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.705078] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.705253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.705303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.705505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.705651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.718278] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 954.922863] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 954.923267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.923516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.923945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.924444] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.924626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.924692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.925046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.925128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.925377] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.083362] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.083362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.149036] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.149036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.149036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.149036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.149036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.149036] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 72d74464-4066-4d23-8644-35d44817e426 not found, creating... [ 955.149036] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.149036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.149036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.149485] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.149627] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.149974] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.150458] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.150458] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.151463] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.151580] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.151721] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 72d74464-4066-4d23-8644-35d44817e426 is going to be created. [ 955.173815] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.174197] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.174261] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.174524] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.174849] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.175088] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.428709] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.492747] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 955.493124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.493391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.493701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.494025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.494244] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.494376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.494554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.494822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.495013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.495595] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.930979] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.938027] env[65788]: INFO networking_nsxv3.common.synchronization [req-4a6392ac-6e5d-4397-b9c0-5f98c0405536 req-c050d003-480b-4c5e-ae3d-0263a562b31e service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 955.938027] env[65788]: INFO networking_nsxv3.common.synchronization [req-4a6392ac-6e5d-4397-b9c0-5f98c0405536 req-c050d003-480b-4c5e-ae3d-0263a562b31e service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 955.938027] env[65788]: INFO networking_nsxv3.common.synchronization [req-4a6392ac-6e5d-4397-b9c0-5f98c0405536 req-c050d003-480b-4c5e-ae3d-0263a562b31e service nova] Enqueued Resource ID: 72d74464-4066-4d23-8644-35d44817e426 with Priority: HIGHEST for action port [ 955.938553] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 955.938683] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 955.939039] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72d74464-4066-4d23-8644-35d44817e426 with Priority: HIGHEST for action port [ 955.939252] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.939393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.939466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.939679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.939764] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.942375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.942491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.943303] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-72d74464-4066-4d23-8644-35d44817e426 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.943303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.943473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.943588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.943666] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72d74464-4066-4d23-8644-35d44817e426',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.997541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.003114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.003114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.003114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.003114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.004035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.004035] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.153039] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 in Status: SUCCESS [ 956.153228] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 deletion is rescheduled due to dependency. [ 956.153344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.251733] env[65788]: INFO networking_nsxv3.common.synchronization [req-26e243b0-ed02-4d93-a644-f118531ecbd5 req-3ac703ad-5bde-4587-aaa7-d32ef3b52718 tempest-ServerAddressesNegativeTestJSON-1215978525 tempest-ServerAddressesNegativeTestJSON-1215978525-project-member] Enqueued Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_members [ 956.253260] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 with Priority: HIGHEST for action security_group_members [ 956.253779] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d96e629-2a5d-4253-97dc-c6a3cd034461 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.253978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.254102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.254407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.254935] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.255126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.255205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.255385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.255480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.255586] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d96e629-2a5d-4253-97dc-c6a3cd034461',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.434477] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.434477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.434477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.434757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.434890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.435012] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 956.446238] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.446386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.446591] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72d74464-4066-4d23-8644-35d44817e426 with status ACTIVE [ 956.446836] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.446937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.446937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.447185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.447274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.447454] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.447574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.447633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.447792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.447909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.448062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.448165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.448352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.448352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.448450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.448492] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72d74464-4066-4d23-8644-35d44817e426 is going to be updated. [ 956.480174] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.480575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.480575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.480713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.480817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.489242] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.489470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.489551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.489731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.489869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.490055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72d74464-4066-4d23-8644-35d44817e426" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.497621] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 956.506239] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c86f5e-5e15-4193-915e-454c2a0bcd6a: rpc.has_security_group_logging(os_id): False [ 956.534453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.534648] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.534762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.534927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.535027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.535270] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.535374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.535438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.535603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.535705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.535894] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.536024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.536077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.536197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.536272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.536451] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.536542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.536604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.536741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.536815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.536902] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 956.665851] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.665991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.666134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.668362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.668362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.693023] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 956.741048] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 956.742683] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 956.742683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.742683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.742683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.742683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.742683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.743052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.743052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.743052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.743136] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.757546] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.758489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.758659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.759064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.759282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.759762] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.759862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.760009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.760292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.760491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.760655] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 is going to be updated. [ 956.817582] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.817766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.817811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.818035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.818186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.830858] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 in Status: IN_PROGRESS for 2s [ 957.245888] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.504025] env[65788]: INFO networking_nsxv3.common.synchronization [None req-33137cba-3dc0-472e-854a-aa044d40dfbc None None] Enqueued Resource ID: 506c2079-58b1-45d1-a872-b0eca4c992f1 with Priority: HIGHEST for action port [ 957.504505] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c2079-58b1-45d1-a872-b0eca4c992f1 with Priority: HIGHEST for action port [ 957.505312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-506c2079-58b1-45d1-a872-b0eca4c992f1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.505312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-506c2079-58b1-45d1-a872-b0eca4c992f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.505312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-506c2079-58b1-45d1-a872-b0eca4c992f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.508928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-506c2079-58b1-45d1-a872-b0eca4c992f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.508928] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('506c2079-58b1-45d1-a872-b0eca4c992f1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.752072] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.774498] env[65788]: INFO networking_nsxv3.common.synchronization [req-3dcb8f80-be38-4509-bbe7-8bfcaa417f39 req-abde5a41-0693-4b50-b33a-45272ca418a2 tempest-ServerGroupTestJSON-790837350 tempest-ServerGroupTestJSON-790837350-project-member] Enqueued Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_members [ 957.775332] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_members [ 957.775793] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.776138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.776280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.776613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.776889] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.777183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.777327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.777613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.777793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.777973] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.011487] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 506c2079-58b1-45d1-a872-b0eca4c992f1 [ 958.012758] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.012908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.012964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.013231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.013317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.013902] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:506c2079-58b1-45d1-a872-b0eca4c992f1 already deleted. [ 958.013902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-506c2079-58b1-45d1-a872-b0eca4c992f1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.254785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.255127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.255127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.255221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.255306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.256768] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 958.280817] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.281000] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.281433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.281433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.281433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.281612] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.281678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.281713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.281852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.281921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.282011] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c already deleted. [ 958.282541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.289762] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.289908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.289981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.290187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.290327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.301791] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 958.316970] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.317283] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-403" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.317412] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-403" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.317717] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-403" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.317975] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.319932] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.320079] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.320322] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.322516] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.322889] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.323031] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.323147] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.323256] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.323378] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.323810] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.323810] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.357111] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.357311] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.357428] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.357609] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-403" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.357989] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.358194] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.358317] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.358647] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.358787] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.509900] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 958.510261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.510393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.510540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.510753] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.510902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.510974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.511166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.511166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.511311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.511371] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.714194] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 958.714415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.714629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.714858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.714949] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.848050] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 in Status: SUCCESS [ 958.849094] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d96e629-2a5d-4253-97dc-c6a3cd034461 deletion is rescheduled due to dependency. [ 958.849349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d96e629-2a5d-4253-97dc-c6a3cd034461" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.861263] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.861511] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.861639] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.861934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.862098] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.862256] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a not found, creating... [ 958.862586] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.862729] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.862849] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.863100] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.863238] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.863527] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.863687] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.863803] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.864030] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.866340] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.866540] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a is going to be created. [ 958.903041] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.903041] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.903041] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.903041] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.903041] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.903041] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.014345] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.015552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.018992] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.018992] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.018992] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.018992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.020115] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.220905] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.221235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.221365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.221594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.221809] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.221971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.222087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.222299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.222390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.222620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.222697] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.524819] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1: rpc.has_security_group_logging(os_id): False [ 959.546375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.546563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.546605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.546857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.546949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.547235] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.547382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.547461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.547620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.547702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.547949] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.548093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.548195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.548368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.548450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.548641] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.548739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.549193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.549193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.551036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.551634] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 959.624946] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.624946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.624946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.624946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.624946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.646512] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 959.718583] env[65788]: INFO networking_nsxv3.common.synchronization [req-3dcb8f80-be38-4509-bbe7-8bfcaa417f39 req-4ab6a5db-ec68-4c29-8840-17b4a06af396 service nova] Enqueued Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_rules [ 959.718778] env[65788]: INFO networking_nsxv3.common.synchronization [req-3dcb8f80-be38-4509-bbe7-8bfcaa417f39 req-4ab6a5db-ec68-4c29-8840-17b4a06af396 service nova] Enqueued Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_members [ 959.719177] env[65788]: INFO networking_nsxv3.common.synchronization [req-3dcb8f80-be38-4509-bbe7-8bfcaa417f39 req-4ab6a5db-ec68-4c29-8840-17b4a06af396 service nova] Enqueued Resource ID: 63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a with Priority: HIGHEST for action port [ 959.719961] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_rules [ 959.720129] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_members [ 959.720244] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a with Priority: HIGHEST for action port [ 959.720573] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.720682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.720747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.720969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.721062] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.722010] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.722998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.727040] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.727040] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.727040] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.727040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.727040] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.729968] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.730439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.732018] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.732018] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.732018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.732672] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.732940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.733179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.733534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.733847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.737085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.737085] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.234857] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.234857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.234857] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.236832] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a with status ACTIVE [ 960.237552] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.237552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.237552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.237552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.237552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.237899] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.237899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.237899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.238023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.238145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.238263] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.238355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.238483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.238642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.238719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.238933] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a is going to be updated. [ 960.240357] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c86f5e-5e15-4193-915e-454c2a0bcd6a: rpc.has_security_group_logging(os_id): False [ 960.259769] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.259941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.260014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.260309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.260401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.260869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.260869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.260869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.261302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.261302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.261302] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.261302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.261302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.261754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.261754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.261754] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.262085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.262085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.262085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.262085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.262278] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 960.264561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.264784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.264784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.265365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.265365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.265365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63b936d0-8dfa-4e23-b39e-f0f4d78e4c8a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.312615] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 960.312801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.313349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.313557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.313921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.313921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.314136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.314180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.314269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.314356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.314451] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.347189] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.347434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.347536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.347866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.349618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.382789] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 960.736610] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.817185] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.817642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.817642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.818197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.818197] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.818197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.818197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.818807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.820405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.820405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.823663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.823663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.823663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.823663] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.824801] env[65788]: INFO networking_nsxv3.common.synchronization [None req-277f4008-48a1-4bec-8a42-fb79fc36e62d None None] Enqueued Resource ID: 6e839555-a46d-4cae-9faf-523ac3864d18 with Priority: HIGHEST for action port [ 960.826232] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e839555-a46d-4cae-9faf-523ac3864d18 with Priority: HIGHEST for action port [ 960.826570] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e839555-a46d-4cae-9faf-523ac3864d18 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.828158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e839555-a46d-4cae-9faf-523ac3864d18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.828158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e839555-a46d-4cae-9faf-523ac3864d18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.828158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e839555-a46d-4cae-9faf-523ac3864d18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.828158] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e839555-a46d-4cae-9faf-523ac3864d18',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.242023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.242023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.242023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.242023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.242023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.242023] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c is going to be created. [ 961.268853] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.268853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.268853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.269059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.270683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.281580] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c in Status: UNINITIALIZED for 2s [ 961.326747] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f8fa77-dfd6-4877-84c2-f9760d23fdfb: rpc.has_security_group_logging(os_id): False [ 961.329493] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e839555-a46d-4cae-9faf-523ac3864d18 [ 961.329656] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.329785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.329849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.330195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.330333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.330599] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e839555-a46d-4cae-9faf-523ac3864d18 already deleted. [ 961.330749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e839555-a46d-4cae-9faf-523ac3864d18" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.348422] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.348639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.348639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.349285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.349285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.349285] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.349462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.349462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.349636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.350858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.351089] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.351193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.351256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.351406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.351484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.351681] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.351792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.351845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.351964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.352053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.352139] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 961.424371] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.424587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.424587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.425120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.425120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.440514] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 961.446635] env[65788]: INFO networking_nsxv3.common.synchronization [req-240445c0-5ca6-4937-bb8c-a7bea53d287f req-c8dd8290-77c7-401d-92d6-5f740d49d0cf tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 961.447185] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 961.447746] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.447884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.447952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.448227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.448453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.448610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.448665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.448827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.448925] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.449028] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.666090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 961.666406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.883979] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.884310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.884404] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.884772] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.886236] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.886236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.886236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.886236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.886236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.886236] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.886526] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.886526] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.886599] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.886719] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.886886] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.887057] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.911554] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.911740] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.911925] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.912124] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.912487] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.912731] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.912877] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.913299] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.913466] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.954272] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.954272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.954272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.954477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.954477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.954707] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.954777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.954820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.954989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.955079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.955167] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec already deleted. [ 961.955246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.398441] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 962.398441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.419688] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.419930] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.420090] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.420460] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.420566] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.420747] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 not found, creating... [ 962.421148] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.421346] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.421467] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.421770] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.421912] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.423279] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.423454] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.423593] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.423807] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.424026] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.424203] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 is going to be created. [ 962.445444] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.445814] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.446032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.446450] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.446794] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.447174] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.231449] env[65788]: INFO networking_nsxv3.common.synchronization [req-3be69646-b048-4749-b4bf-6a3a1d025985 req-4059c88b-6aa5-49cd-9fa0-6b4b0f5bf930 tempest-ImagesTestJSON-1581225727 tempest-ImagesTestJSON-1581225727-project-member] Enqueued Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 963.231449] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482328ee-c8ae-447e-af1f-c321cd088282 with Priority: HIGHEST for action security_group_members [ 963.231449] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-482328ee-c8ae-447e-af1f-c321cd088282 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.231449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.231449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.231449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.232250] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.232426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.232523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.232745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.232832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.232930] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482328ee-c8ae-447e-af1f-c321cd088282',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.264522] env[65788]: INFO networking_nsxv3.common.synchronization [req-240445c0-5ca6-4937-bb8c-a7bea53d287f req-983fe97c-dbfb-4d81-9b41-554c40319bf0 service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 963.264770] env[65788]: INFO networking_nsxv3.common.synchronization [req-240445c0-5ca6-4937-bb8c-a7bea53d287f req-983fe97c-dbfb-4d81-9b41-554c40319bf0 service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 963.265475] env[65788]: INFO networking_nsxv3.common.synchronization [req-240445c0-5ca6-4937-bb8c-a7bea53d287f req-983fe97c-dbfb-4d81-9b41-554c40319bf0 service nova] Enqueued Resource ID: 454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 with Priority: HIGHEST for action port [ 963.266240] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 963.266417] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 963.266492] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 with Priority: HIGHEST for action port [ 963.266909] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.266909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.267038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.267248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.267248] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.268133] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.268376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.269270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.269270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.269270] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.269440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.269440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.269511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.269595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.269774] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.270574] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.270574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.270727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.270785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.270858] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.293208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c in Status: SUCCESS [ 963.293906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.293906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.294181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.294227] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.294760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.294760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.294760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.294760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.294760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.295042] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.461843] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 963.462087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.735736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.735900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.736294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.736294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.736438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.736641] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.737054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.737144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.737310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.737386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.737471] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 is going to be updated. [ 963.768649] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.770904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.770904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.770904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.770904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.773479] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.773479] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.773479] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.780219] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 with status ACTIVE [ 963.780219] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.780219] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.780219] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.780219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.780219] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6 is going to be updated. [ 963.786234] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: IN_PROGRESS for 2s [ 963.797086] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.797207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.797255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.797440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.797610] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.797783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.797855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.797999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.798094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.798183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.798332] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.798456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.798490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.798637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.798816] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.798909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.798962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.799165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.799230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.799316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.799404] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.806976] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.807144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.807190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.807391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.807528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.807700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-454d71f1-d7d1-4d6d-adc7-ba1e1d05a5a6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.275304] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.301527] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 764f3a47-7b97-412a-ab36-7fb97a84a17c: rpc.has_security_group_logging(os_id): False [ 964.322793] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.322979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.323032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.323236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.323319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.323524] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.323673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.323735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.323904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.324017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.324309] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.324391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.324391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.324510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.324579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.324944] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.325068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.325156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.325319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.325419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.325531] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c is going to be created. [ 964.395153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.395153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.395153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.395153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.395153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.409990] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c in Status: IN_PROGRESS for 2s [ 964.528742] env[65788]: INFO networking_nsxv3.common.synchronization [req-380d4d74-89b1-41e8-b312-4dc3588b6438 req-6b4c2477-c627-4d94-a0f6-086b55b05149 tempest-InstanceActionsTestJSON-1965762885 tempest-InstanceActionsTestJSON-1965762885-project-member] Enqueued Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_members [ 964.528742] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGHEST for action security_group_members [ 964.529123] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.529463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.529744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.530098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.532312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.532312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.532312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.532312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.532312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.532312] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.780372] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.780372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.780372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.780372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.780372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.780372] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be created. [ 964.797044] env[65788]: INFO networking_nsxv3.common.synchronization [req-379f0c43-4bbe-4f92-92d4-031c4d9dd55d req-813a0fc4-71a4-46e7-b43f-d56558523cfc tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 964.798666] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 964.798666] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.798666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.798666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.798666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.799140] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.799140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.799140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.799140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.799343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.799343] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.808676] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.808998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.808998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.809151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.809345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.826623] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: UNINITIALIZED for 2s [ 965.036407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.036407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.036407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.036407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.036686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.037912] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.037912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.037912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.037912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.037912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.037912] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb83c2-5239-4c9a-ba59-1206501032bb is going to be updated. [ 965.082534] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.082534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.082534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.082534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.082534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.095088] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb83c2-5239-4c9a-ba59-1206501032bb in Status: IN_PROGRESS for 2s [ 965.280365] env[65788]: INFO networking_nsxv3.common.synchronization [req-379f0c43-4bbe-4f92-92d4-031c4d9dd55d req-8b322353-07a8-4abc-b299-93605ddc20f1 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 965.281072] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 965.281373] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.281468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.301980] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.566948] env[65788]: INFO networking_nsxv3.common.synchronization [req-379f0c43-4bbe-4f92-92d4-031c4d9dd55d req-a2f53487-4b9e-475b-9608-b06c39601244 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 965.567318] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 965.568651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.568782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.804025] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482328ee-c8ae-447e-af1f-c321cd088282 in Status: SUCCESS [ 965.804025] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482328ee-c8ae-447e-af1f-c321cd088282 deletion is rescheduled due to dependency. [ 965.804025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482328ee-c8ae-447e-af1f-c321cd088282" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.806409] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.308617] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.309267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.309267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.309267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.309267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.309471] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 966.344803] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.344803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.344803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.345195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.345195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.358171] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 966.425054] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c in Status: SUCCESS [ 966.425739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.839720] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 966.839720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.839720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.841247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.841247] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.841247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.841247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.841247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.841247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.841247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.841247] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.105357] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbcb83c2-5239-4c9a-ba59-1206501032bb in Status: SUCCESS [ 967.105524] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbcb83c2-5239-4c9a-ba59-1206501032bb deletion is rescheduled due to dependency. [ 967.105524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.346049] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.849702] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec: rpc.has_security_group_logging(os_id): False [ 967.870626] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.872589] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.872589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.872589] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be created. [ 967.941591] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.941933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.941933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.942121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.942298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.958252] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 968.372960] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 968.372960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.373313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.373313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.373571] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.373700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.374041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.374314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.374400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.374510] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.877665] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.877929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.878089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.879159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.879159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.879159] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.879159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.879159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.879159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.879537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.879537] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 968.953100] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.953332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.953332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.953999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.953999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.967018] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 969.302801] env[65788]: INFO networking_nsxv3.common.synchronization [req-92b23625-0b53-48c8-a87c-3559eb7595a8 req-6ca5996a-c473-4709-bfa5-d291adaa5f9c tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 969.303439] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 969.303905] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.304021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.304139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.304293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.304454] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.304556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.304620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.304774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.304858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.304953] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.808046] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.981845] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 969.982025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.310800] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.346238] env[65788]: INFO networking_nsxv3.common.synchronization [req-aa820c88-fee8-4ad2-b5eb-ea8d640f7a37 req-c535538c-f0a1-45a9-9666-fb8c642eb6a2 tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 970.349185] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 970.349185] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.349185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.349185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.349185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.349185] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.349185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.349185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.349185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.349185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.349185] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.813769] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.814182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.814308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.814613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.814727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.816045] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be updated. [ 970.846548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.846761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.846761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.846979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.847367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.850405] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.857725] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: IN_PROGRESS for 2s [ 970.966417] env[65788]: INFO networking_nsxv3.common.synchronization [req-7e764e51-ea49-45c6-b5e0-c4438efad976 req-4fff9161-6f2c-4c24-8954-ea818203b46e tempest-ServersTestJSON-302710182 tempest-ServersTestJSON-302710182-project-member] Enqueued Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_members [ 970.966417] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c with Priority: HIGHEST for action security_group_members [ 970.966517] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.966676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.966720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.967541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.967541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.967541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.967541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.967541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.967541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.967541] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2d9519-fb22-49d0-a2e2-a6d300763f8c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.979634] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 970.979821] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a deletion is rescheduled due to dependency. [ 970.979963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.980401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.980669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.980858] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.980969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.981236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.981236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.981337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.981367] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.352499] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.446700] env[65788]: INFO networking_nsxv3.common.synchronization [req-ea8b4ab9-053f-46ac-84d7-91e6b1dd1be9 req-40e0d073-e299-41ed-b43c-4ec3474927d6 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_members [ 971.447305] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_members [ 971.447625] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.447757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.447836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.448246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.448455] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.448615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.448691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.448928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.449036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.449171] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.474488] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.474488] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.474488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.474488] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c is going to be updated. [ 971.487527] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.487527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.487527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.487527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.487527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.487527] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.487796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.487796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.487853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.489664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.489664] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 971.511548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.512994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.512994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.512994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.512994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.523559] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.523559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.523559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.523559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.523559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.526248] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c in Status: IN_PROGRESS for 2s [ 971.537188] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 971.860062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.860575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.861128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.861619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.861880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.863484] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 971.907193] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.907193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.907193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.907193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.907193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.918832] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 971.943648] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.943941] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.944082] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.944427] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.944813] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.944946] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.945075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.945523] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.945767] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.946111] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.946330] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.946538] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.946734] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.946850] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.946968] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.947145] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.953248] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.953248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.953248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.953248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.953248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.953248] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.953248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.953248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.953248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.953881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.953881] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 already deleted. [ 971.953881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.970541] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.970759] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.970977] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.971243] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.971673] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.972029] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.972418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.973333] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.973333] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7501650-bbf0-4403-a8d9-9f9859dcc1c6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.475948] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.476865] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.476865] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.476865] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.477184] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.477184] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port f7501650-bbf0-4403-a8d9-9f9859dcc1c6 not found, creating... [ 972.477527] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.477681] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.477772] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.480279] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.480469] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.480871] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.481086] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.481213] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.481482] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.481649] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.481818] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: f7501650-bbf0-4403-a8d9-9f9859dcc1c6 is going to be created. [ 972.504181] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.504526] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.504526] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.504820] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.505216] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.505426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.869155] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 972.869155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.112905] env[65788]: INFO networking_nsxv3.common.synchronization [req-76153708-ba6e-497e-bf84-c7bfe5d276e3 req-695e50bc-0141-4f3e-b9ee-28dbd2422e71 tempest-ServerGroupTestJSON-790837350 tempest-ServerGroupTestJSON-790837350-project-member] Enqueued Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_members [ 973.113495] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGHEST for action security_group_members [ 973.113794] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.113913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.113977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.114186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.116663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.116663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.116663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.116663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.116663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.116663] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.261044] env[65788]: INFO networking_nsxv3.common.synchronization [req-ea8b4ab9-053f-46ac-84d7-91e6b1dd1be9 req-d1713860-7c32-48a3-85c3-764de0b9b246 service nova] Enqueued Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_rules [ 973.261044] env[65788]: INFO networking_nsxv3.common.synchronization [req-ea8b4ab9-053f-46ac-84d7-91e6b1dd1be9 req-d1713860-7c32-48a3-85c3-764de0b9b246 service nova] Enqueued Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_members [ 973.261044] env[65788]: INFO networking_nsxv3.common.synchronization [req-ea8b4ab9-053f-46ac-84d7-91e6b1dd1be9 req-d1713860-7c32-48a3-85c3-764de0b9b246 service nova] Enqueued Resource ID: f7501650-bbf0-4403-a8d9-9f9859dcc1c6 with Priority: HIGHEST for action port [ 973.261329] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_rules [ 973.261408] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_members [ 973.261531] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7501650-bbf0-4403-a8d9-9f9859dcc1c6 with Priority: HIGHEST for action port [ 973.262062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.262194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.262262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.262469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.262619] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.263990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.263990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.263990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.264187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.265031] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.265031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.265031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.265031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.265031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.265031] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.266557] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.266743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.266811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.267516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.267516] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7501650-bbf0-4403-a8d9-9f9859dcc1c6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.535950] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c in Status: SUCCESS [ 973.536315] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2d9519-fb22-49d0-a2e2-a6d300763f8c deletion is rescheduled due to dependency. [ 973.536482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2d9519-fb22-49d0-a2e2-a6d300763f8c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.547235] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 973.547235] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a deletion is rescheduled due to dependency. [ 973.547235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.617397] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.617578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.617653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.617911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.618036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.618274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.618392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.618467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.618634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.618758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.618825] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c is going to be updated. [ 973.651715] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.651887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.651981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.652233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.652401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.661873] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c in Status: IN_PROGRESS for 2s [ 973.771424] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.771424] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.771424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.771424] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7501650-bbf0-4403-a8d9-9f9859dcc1c6 with status ACTIVE [ 973.771424] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.771424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.771424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.771424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.771424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.771424] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.772910] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.772910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.772910] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7501650-bbf0-4403-a8d9-9f9859dcc1c6 is going to be updated. [ 973.808785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.808970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.809035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.809246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.809384] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.809548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7501650-bbf0-4403-a8d9-9f9859dcc1c6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.928750] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 973.929159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.941039] env[65788]: INFO networking_nsxv3.common.synchronization [req-4fe3e397-ad74-49d6-ac2c-c0338d2f3a7f req-7dff20ae-9a0d-4fc4-a387-3843b6ea2501 tempest-ServerRescueTestJSON-116164819 tempest-ServerRescueTestJSON-116164819-project-member] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 973.941652] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 973.941955] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.942166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.942243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.942498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.942719] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.942879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.942879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.943056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.943125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.943217] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.271998] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.311386] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.311602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.311694] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.312034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.312313] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.312470] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.312586] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.312826] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.312967] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.313235] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.313346] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.313454] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.313562] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.313670] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.313778] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.313915] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.334100] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.334290] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.334437] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.334590] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.334898] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.335080] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.335197] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.335493] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.335628] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e7b05da-d635-4279-be2d-0a1ea8fa2cec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.350539] env[65788]: INFO networking_nsxv3.common.synchronization [req-6a386e5f-eee7-45c9-aede-5b44c526d6b3 req-6f55d670-5f04-4924-aee3-2dbdf9c55579 tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 974.351123] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 974.352157] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.352284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.352349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.352543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.352771] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.353259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.353259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.353259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.353259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.353259] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.446032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.446210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.446275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.446530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.446630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.447396] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.447396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.447396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.447396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.447396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.447396] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 already deleted. [ 974.447801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.776144] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.776318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.776389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.776575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.776664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.776764] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 is going to be created. [ 974.802118] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.802118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.802237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.802374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.802535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.812217] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 in Status: UNINITIALIZED for 2s [ 974.838703] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.839075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.839251] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.839570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.839724] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.839885] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 6e7b05da-d635-4279-be2d-0a1ea8fa2cec not found, creating... [ 974.840182] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.840342] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.840458] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.841314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.841314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.841314] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.841314] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.841542] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.841857] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.842055] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.842186] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 6e7b05da-d635-4279-be2d-0a1ea8fa2cec is going to be created. [ 974.856081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.856231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.856300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.856500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.856603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.856797] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.856897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.856965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.857112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.857185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.857272] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 974.862718] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.862926] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.863059] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.863306] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.863545] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.863787] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.898634] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.898864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.898864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.899063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.899200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.909020] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 975.605986] env[65788]: INFO networking_nsxv3.common.synchronization [req-4fe3e397-ad74-49d6-ac2c-c0338d2f3a7f req-1d86c953-537c-4f76-8ff7-25d2b7014373 service nova] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_rules [ 975.605986] env[65788]: INFO networking_nsxv3.common.synchronization [req-4fe3e397-ad74-49d6-ac2c-c0338d2f3a7f req-1d86c953-537c-4f76-8ff7-25d2b7014373 service nova] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 975.605986] env[65788]: INFO networking_nsxv3.common.synchronization [req-4fe3e397-ad74-49d6-ac2c-c0338d2f3a7f req-1d86c953-537c-4f76-8ff7-25d2b7014373 service nova] Enqueued Resource ID: 6e7b05da-d635-4279-be2d-0a1ea8fa2cec with Priority: HIGHEST for action port [ 975.605986] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_rules [ 975.605986] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 975.605986] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7b05da-d635-4279-be2d-0a1ea8fa2cec with Priority: HIGHEST for action port [ 975.605986] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.605986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.605986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.605986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.605986] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.605986] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.605986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.605986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.605986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.606863] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.606863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.606863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.606863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.606863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.606863] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.610157] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.610351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.610437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.610646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.610728] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e7b05da-d635-4279-be2d-0a1ea8fa2cec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.673077] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c in Status: IN_PROGRESS for 4s [ 976.114013] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.114171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.114366] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.115324] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e7b05da-d635-4279-be2d-0a1ea8fa2cec with status ACTIVE [ 976.115466] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.115575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.115655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.115835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.115921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.116112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.116208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.116270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.116419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.116494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.116670] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.116762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.116820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.116954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.117038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.117122] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e7b05da-d635-4279-be2d-0a1ea8fa2cec is going to be updated. [ 976.146275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.146423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.146495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.146721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.146861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.147040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e7b05da-d635-4279-be2d-0a1ea8fa2cec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.619073] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.823994] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 in Status: SUCCESS [ 976.824214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.824376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.824732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.824994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.825171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.825251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.825716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.825716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.825716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.825716] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.918225] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 976.918384] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 976.918506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.123274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.123274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.123274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.123274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.123274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.123274] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be created. [ 977.148362] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.148516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.148559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.148794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.148996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.164544] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: UNINITIALIZED for 2s [ 977.328475] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.686024] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c in Status: SUCCESS [ 977.686024] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c deletion is rescheduled due to dependency. [ 977.686024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.832114] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61c7676a-9165-4a1a-b58b-8faa9c5567b8: rpc.has_security_group_logging(os_id): False [ 977.851335] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.852233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.852233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.852233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.852233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.852233] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.852233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.852233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.852493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.852493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.852551] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 is going to be created. [ 977.918469] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.919418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.919418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.919418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.919418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.932313] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 in Status: IN_PROGRESS for 2s [ 979.177425] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: SUCCESS [ 979.177425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.177425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.177945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.177945] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.177945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.177945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.178137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.178137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.178200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.178355] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.680727] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.680941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.681035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.681249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.681428] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.681547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.681615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.681724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.681816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.681917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.682070] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.682164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.682223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.682400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.682517] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.682601] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.682664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.682806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.682885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.683049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.683176] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.946091] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 in Status: SUCCESS [ 979.946679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.185647] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0192141c-b766-4f81-bfc9-7eab487b7c37: rpc.has_security_group_logging(os_id): False [ 980.208785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.208897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.208955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.209181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.209283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.209489] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.210387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.210387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.210387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.210387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.210387] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.210387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.210387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.210763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.210763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.210830] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.211928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.211928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.211928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.211928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.211928] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be created. [ 980.283209] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.283359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.283434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.283637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.283816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.294886] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: IN_PROGRESS for 2s [ 980.603892] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 980.604011] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 982.310037] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: SUCCESS [ 982.310345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.534148] env[65788]: INFO networking_nsxv3.common.synchronization [None req-539869e0-2e0f-4db0-8a9a-03862d7f0304 None None] Enqueued Resource ID: 79ff37e2-d886-42ca-bc32-e9166181d2c0 with Priority: HIGHEST for action port [ 982.534148] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ff37e2-d886-42ca-bc32-e9166181d2c0 with Priority: HIGHEST for action port [ 982.535087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-79ff37e2-d886-42ca-bc32-e9166181d2c0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.535502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79ff37e2-d886-42ca-bc32-e9166181d2c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.535785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79ff37e2-d886-42ca-bc32-e9166181d2c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.536291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79ff37e2-d886-42ca-bc32-e9166181d2c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.536712] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79ff37e2-d886-42ca-bc32-e9166181d2c0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.736675] env[65788]: INFO networking_nsxv3.common.synchronization [None req-86e43e44-a45e-4504-bf6e-f3ccb05caaae None None] Enqueued Resource ID: 826ece92-0886-44dd-855d-fc18164da1a3 with Priority: HIGHEST for action port [ 982.736958] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826ece92-0886-44dd-855d-fc18164da1a3 with Priority: HIGHEST for action port [ 982.737548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-826ece92-0886-44dd-855d-fc18164da1a3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.737767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-826ece92-0886-44dd-855d-fc18164da1a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.737922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-826ece92-0886-44dd-855d-fc18164da1a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.738764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-826ece92-0886-44dd-855d-fc18164da1a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.738886] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('826ece92-0886-44dd-855d-fc18164da1a3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.040570] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79ff37e2-d886-42ca-bc32-e9166181d2c0 [ 983.040570] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.040782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.040782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.041029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.041119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.041338] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79ff37e2-d886-42ca-bc32-e9166181d2c0 already deleted. [ 983.041338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79ff37e2-d886-42ca-bc32-e9166181d2c0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.241487] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 826ece92-0886-44dd-855d-fc18164da1a3 [ 983.241731] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.241894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.242031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.242266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.242368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.242563] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:826ece92-0886-44dd-855d-fc18164da1a3 already deleted. [ 983.242596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-826ece92-0886-44dd-855d-fc18164da1a3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.260734] env[65788]: INFO networking_nsxv3.common.synchronization [req-8fd18dc5-39e7-49e0-a984-aa185e5f9e96 req-1ff3dcb0-3afa-404f-afc7-40c6cbdc91ff tempest-ServersWithSpecificFlavorTestJSON-1851839051 tempest-ServersWithSpecificFlavorTestJSON-1851839051-project-member] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 983.261271] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGHEST for action security_group_members [ 983.261580] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.261706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.261779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.261969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.262364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.262477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.262541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.262739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.262840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.262946] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.770994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.770994] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.770994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.770994] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be updated. [ 983.810114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.810348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.810348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.810607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.810713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.831550] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: IN_PROGRESS for 2s [ 983.875505] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-223 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.875505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.875505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.875505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.876516] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.876838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.877152] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.883027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.883027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.883027] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.883027] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.883027] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.883027] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.883027] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.883027] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.883027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.923151] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.923151] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 983.923151] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.923151] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-223" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.923151] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-cdb92fba-2145-4abf-bb64-5ba310a8aa24 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.926149] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.926333] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.929033] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.929033] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb92fba-2145-4abf-bb64-5ba310a8aa24',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.434680] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.434680] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.434947] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.434947] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.435143] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.435428] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.435581] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.435864] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.435929] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.436341] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.436787] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.436959] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.437088] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.437308] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.437441] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.437580] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 is going to be updated. [ 984.461306] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.461522] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.461646] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.461930] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.462134] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.462361] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.235681] env[65788]: INFO networking_nsxv3.common.synchronization [req-42fbdb92-f0b8-4f92-86d4-a9ef558cb9ea req-09abfa18-bb7f-4f1c-bece-6fac45875789 service nova] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_rules [ 985.235932] env[65788]: INFO networking_nsxv3.common.synchronization [req-42fbdb92-f0b8-4f92-86d4-a9ef558cb9ea req-09abfa18-bb7f-4f1c-bece-6fac45875789 service nova] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 985.236099] env[65788]: INFO networking_nsxv3.common.synchronization [req-42fbdb92-f0b8-4f92-86d4-a9ef558cb9ea req-09abfa18-bb7f-4f1c-bece-6fac45875789 service nova] Enqueued Resource ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 with Priority: HIGHEST for action port [ 985.236238] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_rules [ 985.236368] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 985.236464] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 with Priority: HIGHEST for action port [ 985.238513] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.238952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.238952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.238952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.239171] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.240686] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.240686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.240686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.240686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.240686] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.240686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.240686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.242293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.242293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.242293] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.242782] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdb92fba-2145-4abf-bb64-5ba310a8aa24 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.242974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.243081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.243195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.243247] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb92fba-2145-4abf-bb64-5ba310a8aa24',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.486334] env[65788]: INFO networking_nsxv3.common.synchronization [None req-a90273cd-ddbb-431f-8d96-bde909cbe0c2 None None] Enqueued Resource ID: 8a3d5d82-459f-4b3b-911b-b11bedb5eda4 with Priority: HIGHEST for action port [ 985.486334] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3d5d82-459f-4b3b-911b-b11bedb5eda4 with Priority: HIGHEST for action port [ 985.486334] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a3d5d82-459f-4b3b-911b-b11bedb5eda4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.486334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a3d5d82-459f-4b3b-911b-b11bedb5eda4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.486334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a3d5d82-459f-4b3b-911b-b11bedb5eda4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.486334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a3d5d82-459f-4b3b-911b-b11bedb5eda4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.486334] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a3d5d82-459f-4b3b-911b-b11bedb5eda4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.724990] env[65788]: INFO networking_nsxv3.common.synchronization [None req-728d253d-94aa-4ee9-bde1-b11498e08411 None None] Enqueued Resource ID: 51472808-48aa-4b22-90e3-9875106ac5f3 with Priority: HIGHEST for action port [ 985.725487] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51472808-48aa-4b22-90e3-9875106ac5f3 with Priority: HIGHEST for action port [ 985.725792] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-51472808-48aa-4b22-90e3-9875106ac5f3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.725905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51472808-48aa-4b22-90e3-9875106ac5f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.726145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51472808-48aa-4b22-90e3-9875106ac5f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.727382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51472808-48aa-4b22-90e3-9875106ac5f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.727454] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51472808-48aa-4b22-90e3-9875106ac5f3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.744959] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.745750] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.745890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.746170] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdb92fba-2145-4abf-bb64-5ba310a8aa24 with status ACTIVE [ 985.746170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.746360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.746360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.747017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.747017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.747017] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.747017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.747017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.747017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.747278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.747278] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.749707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.749707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.749707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.749707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.749707] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdb92fba-2145-4abf-bb64-5ba310a8aa24 is going to be updated. [ 985.750639] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3b3dac56-80b7-4888-a5b9-f484d583ca1e tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_rules [ 985.751546] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_rules [ 985.751829] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.752930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.752930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.752930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.752930] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.775941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.775941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.775941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.776104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.776136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.776346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdb92fba-2145-4abf-bb64-5ba310a8aa24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.861495] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 in Status: SUCCESS [ 985.861641] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 deletion is rescheduled due to dependency. [ 985.863458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.868041] env[65788]: INFO networking_nsxv3.common.synchronization [None req-92bf36be-a86a-4177-a307-9ad99c1e8e04 tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_rules [ 985.868612] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_rules [ 985.869106] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.869264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.991287] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a3d5d82-459f-4b3b-911b-b11bedb5eda4 [ 985.991545] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.991759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.991759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.992020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.992134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.992242] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a3d5d82-459f-4b3b-911b-b11bedb5eda4 already deleted. [ 985.992346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a3d5d82-459f-4b3b-911b-b11bedb5eda4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.231376] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51472808-48aa-4b22-90e3-9875106ac5f3 [ 986.231376] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.231376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.231376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.231376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.231376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.231376] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51472808-48aa-4b22-90e3-9875106ac5f3 already deleted. [ 986.231376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51472808-48aa-4b22-90e3-9875106ac5f3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.249837] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.275426] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.275583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.275654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.275912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.276040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.276161] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd already deleted. [ 986.276362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.276472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.276653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.276753] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.754724] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.754917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.755047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.755306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.755416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.755821] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 986.793353] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.793584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.794026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.794026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.794214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.798372] env[65788]: INFO networking_nsxv3.common.synchronization [req-713edb4d-bbab-4c30-ba38-4f1a80c23c98 req-1ed8f2af-02bd-4d4b-bad1-b353891fa84b tempest-SecurityGroupRulesTestJSON-1908971892 tempest-SecurityGroupRulesTestJSON-1908971892-project-member] Enqueued Resource ID: 46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4 with Priority: HIGHEST for action security_group_rules [ 986.799500] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.799649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.799694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.799891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.799985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.800096] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd already deleted. [ 986.800183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.800697] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4 with Priority: HIGHEST for action security_group_rules [ 986.801036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.801169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.801247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.801523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.801603] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.806570] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 987.325760] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.326139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.326139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.326261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.326261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.326372] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4 already deleted. [ 987.326457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46c36ebc-f713-4bc7-b15c-ef3e4a7e8bc4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.161762] env[65788]: INFO networking_nsxv3.common.synchronization [req-09d1e721-de32-45da-a943-e759f2594515 req-5ae6f86c-93ca-4084-8def-ad6a0c827788 tempest-SecurityGroupRulesTestJSON-1908971892 tempest-SecurityGroupRulesTestJSON-1908971892-project-member] Enqueued Resource ID: 531a6912-9195-462a-bd11-35fdce65a200 with Priority: HIGHEST for action security_group_rules [ 988.162408] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531a6912-9195-462a-bd11-35fdce65a200 with Priority: HIGHEST for action security_group_rules [ 988.163426] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531a6912-9195-462a-bd11-35fdce65a200 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.163667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531a6912-9195-462a-bd11-35fdce65a200" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.163667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531a6912-9195-462a-bd11-35fdce65a200" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.164017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531a6912-9195-462a-bd11-35fdce65a200" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.164137] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531a6912-9195-462a-bd11-35fdce65a200',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.690502] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.690821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.690821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.691050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.691050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.691147] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531a6912-9195-462a-bd11-35fdce65a200 already deleted. [ 988.691236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531a6912-9195-462a-bd11-35fdce65a200" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.765793] env[65788]: INFO networking_nsxv3.common.synchronization [req-f0185a4d-3aa2-4d2e-82b4-a2f698626ada req-59217673-29d3-41a4-9478-9c60b2f41ae9 tempest-SecurityGroupRulesTestJSON-1908971892 tempest-SecurityGroupRulesTestJSON-1908971892-project-member] Enqueued Resource ID: 44d0d39e-82bf-4836-b6a6-9d2e996cae54 with Priority: HIGHEST for action security_group_rules [ 988.766713] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44d0d39e-82bf-4836-b6a6-9d2e996cae54 with Priority: HIGHEST for action security_group_rules [ 988.769079] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44d0d39e-82bf-4836-b6a6-9d2e996cae54 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.769079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44d0d39e-82bf-4836-b6a6-9d2e996cae54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.769079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44d0d39e-82bf-4836-b6a6-9d2e996cae54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.769079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44d0d39e-82bf-4836-b6a6-9d2e996cae54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.769079] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44d0d39e-82bf-4836-b6a6-9d2e996cae54',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.819371] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 988.819499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.819699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.820038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.820344] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.820559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.820674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.821026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.821341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.821341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.821515] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.963555] env[65788]: INFO networking_nsxv3.common.synchronization [None req-c21e1c34-2f7b-4f79-9973-239c19937748 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 0a0083c7-c424-4186-98d1-5fa9530c4261 with Priority: HIGHEST for action security_group_rules [ 988.964409] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a0083c7-c424-4186-98d1-5fa9530c4261 with Priority: HIGHEST for action security_group_rules [ 988.965085] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a0083c7-c424-4186-98d1-5fa9530c4261 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.967059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.967059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.967059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.967059] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a0083c7-c424-4186-98d1-5fa9530c4261',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.078848] env[65788]: INFO networking_nsxv3.common.synchronization [None req-0d5cb8b1-9cb6-45fa-bf27-3648a544ad2a tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 0a0083c7-c424-4186-98d1-5fa9530c4261 with Priority: HIGHEST for action security_group_rules [ 989.080496] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a0083c7-c424-4186-98d1-5fa9530c4261 with Priority: HIGHEST for action security_group_rules [ 989.080496] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a0083c7-c424-4186-98d1-5fa9530c4261 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.080496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.294860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.295062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.295196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.295336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.295431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.295505] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44d0d39e-82bf-4836-b6a6-9d2e996cae54 already deleted. [ 989.295578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44d0d39e-82bf-4836-b6a6-9d2e996cae54" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.330830] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.331092] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.331184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.331702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.331860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.331933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.331970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.332164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.332254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.332368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.332511] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.333215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.333215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.333215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.333215] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.333215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.333215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.333540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.333540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.333540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.333660] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.489821] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.489821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.489821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.489821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.489821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.489821] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a0083c7-c424-4186-98d1-5fa9530c4261 already deleted. [ 989.489821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.490140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.490140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.490248] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a0083c7-c424-4186-98d1-5fa9530c4261',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.668556] env[65788]: INFO networking_nsxv3.common.synchronization [req-6c6b46cc-f321-4674-8e93-dc45b1b26b00 req-55bb6e53-5374-41ba-ae75-958316f996ef tempest-SecurityGroupRulesTestJSON-1908971892 tempest-SecurityGroupRulesTestJSON-1908971892-project-member] Enqueued Resource ID: 6a0609c8-4dba-466e-b933-7875813fe9f8 with Priority: HIGHEST for action security_group_rules [ 989.669209] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0609c8-4dba-466e-b933-7875813fe9f8 with Priority: HIGHEST for action security_group_rules [ 989.669894] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a0609c8-4dba-466e-b933-7875813fe9f8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.669894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a0609c8-4dba-466e-b933-7875813fe9f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.669894] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a0609c8-4dba-466e-b933-7875813fe9f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.670243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a0609c8-4dba-466e-b933-7875813fe9f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.670243] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a0609c8-4dba-466e-b933-7875813fe9f8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.838064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c1f029-c9a0-40e2-afd5-a6e6e896f095: rpc.has_security_group_logging(os_id): False [ 989.856923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.857123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.857209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.857424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.857535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.857755] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.857857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.857915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.858082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.858155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.858353] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.858447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.858504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.858717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.858772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.858933] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.859121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.859207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.859337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.859406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.859491] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 989.932608] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.934171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.934171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.934171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.934171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.955764] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 990.037286] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.037286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.037419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.037558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.038497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.038635] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a0083c7-c424-4186-98d1-5fa9530c4261 already deleted. [ 990.038726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a0083c7-c424-4186-98d1-5fa9530c4261" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.196421] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.196619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.196687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.197307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.197307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.197307] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a0609c8-4dba-466e-b933-7875813fe9f8 already deleted. [ 990.197307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a0609c8-4dba-466e-b933-7875813fe9f8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.208244] env[65788]: INFO networking_nsxv3.common.synchronization [req-8084fa6f-2074-4b4b-bc8d-5455ac903b08 req-ccab1341-7d05-478c-b6b6-28f4dbed77ed tempest-ServerRescueNegativeTestJSON-1968606072 tempest-ServerRescueNegativeTestJSON-1968606072-project-member] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 990.208812] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGHEST for action security_group_members [ 990.209583] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.209583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.209583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.209859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.210302] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.210477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.210618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.211272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.211466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.211655] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.714905] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.715144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.715239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.715375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.742340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.742680] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.742865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.742959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.743265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.743394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.743471] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be updated. [ 990.782437] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.782635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.782760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.783019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.783200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.793807] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: IN_PROGRESS for 2s [ 991.817156] env[65788]: INFO networking_nsxv3.common.synchronization [req-2731b069-4fe5-42a5-b460-c346f9252140 req-d0f17cdd-f04c-4c96-8649-b7f092c25c02 tempest-SecurityGroupRulesTestJSON-1908971892 tempest-SecurityGroupRulesTestJSON-1908971892-project-member] Enqueued Resource ID: 75f6b703-4bd0-498a-816a-5e89754dcffb with Priority: HIGHEST for action security_group_rules [ 991.818145] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6b703-4bd0-498a-816a-5e89754dcffb with Priority: HIGHEST for action security_group_rules [ 991.818145] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f6b703-4bd0-498a-816a-5e89754dcffb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.818276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.818323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.818629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.818734] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f6b703-4bd0-498a-816a-5e89754dcffb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.975656] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 991.975656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.342781] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.342970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.343071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.343340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.343448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.343575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f6b703-4bd0-498a-816a-5e89754dcffb already deleted. [ 992.343667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.378797] env[65788]: INFO networking_nsxv3.common.synchronization [req-61c4808b-17bc-497f-a55e-dba817bea841 req-6b5ef863-3caf-4cc3-a6f4-edc79560fc38 tempest-SecurityGroupRulesTestJSON-1908971892 tempest-SecurityGroupRulesTestJSON-1908971892-project-member] Enqueued Resource ID: 75f6b703-4bd0-498a-816a-5e89754dcffb with Priority: HIGHEST for action security_group_rules [ 992.379869] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6b703-4bd0-498a-816a-5e89754dcffb with Priority: HIGHEST for action security_group_rules [ 992.381020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f6b703-4bd0-498a-816a-5e89754dcffb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.381119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.381184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.381390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.381476] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f6b703-4bd0-498a-816a-5e89754dcffb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.564920] env[65788]: INFO networking_nsxv3.common.synchronization [req-28ab1703-7ffd-473e-b941-e84a72ef9fb8 req-b729e696-58fa-48ed-86f1-98e54cd810ee tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 992.565622] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 992.565961] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.566578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.566664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.566870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.567057] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.567166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.567246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.567423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.567599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.567754] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.684559] env[65788]: INFO networking_nsxv3.common.synchronization [req-fe6796a9-6afe-414d-bcd8-66bc5ea96d99 req-a95c35b2-2370-4785-8c74-38d44eec017b tempest-SecurityGroupRulesTestJSON-1908971892 tempest-SecurityGroupRulesTestJSON-1908971892-project-member] Enqueued Resource ID: 75f6b703-4bd0-498a-816a-5e89754dcffb with Priority: HIGHEST for action security_group_rules [ 992.684559] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f6b703-4bd0-498a-816a-5e89754dcffb with Priority: HIGHEST for action security_group_rules [ 992.684559] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f6b703-4bd0-498a-816a-5e89754dcffb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.684559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.808081] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 471c938d-6085-49dc-9e65-e361b495b859 in Status: SUCCESS [ 992.808081] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 471c938d-6085-49dc-9e65-e361b495b859 deletion is rescheduled due to dependency. [ 992.808081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.911723] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.911723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.911723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.911723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.911723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.912237] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f6b703-4bd0-498a-816a-5e89754dcffb already deleted. [ 992.912237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.912237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.912485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.913122] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f6b703-4bd0-498a-816a-5e89754dcffb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.072540] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.072755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.072816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.074452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.074452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.074452] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.074452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.074452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.074452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.074452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.074452] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 993.119638] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.119638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.119638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.119638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.119638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.133670] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 993.435284] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.435471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.435525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.436097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.436097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.436097] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f6b703-4bd0-498a-816a-5e89754dcffb already deleted. [ 993.436097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f6b703-4bd0-498a-816a-5e89754dcffb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.157874] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 995.157874] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 995.157874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.364712] env[65788]: INFO networking_nsxv3.common.synchronization [req-0762ca1d-f42e-4875-b1ed-fcf4f93913f6 req-b41e810c-e496-4c0d-8cf3-4b81afe8307b tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 996.365205] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 996.365205] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.365362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.365419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.365697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.365870] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.365977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.366059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.366192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.366302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.366696] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.869215] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.372096] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.875788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.876027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.876132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.876760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.876760] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.876760] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 997.916224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.916375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.916438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.916699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.916854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.929222] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 999.941924] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 999.941924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.366040] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1001.366443] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1003.879485] env[65788]: INFO networking_nsxv3.common.synchronization [req-07f0ea09-49c2-4180-8bb2-fad8ad7fe62d req-45e47bea-b9b9-4486-ba95-20e6a2bf5167 tempest-ListImageFiltersTestJSON-1319309490 tempest-ListImageFiltersTestJSON-1319309490-project-member] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 1003.880305] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 1003.880630] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.880844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.880908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.881169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.881339] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.881445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.881952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.881952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.881952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.881952] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.384431] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.887945] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.391629] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.391861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.391921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.392175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.392297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.392357] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 is going to be updated. [ 1005.433826] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.434083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.434227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.434552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.434801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.443854] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: IN_PROGRESS for 2s [ 1006.360564] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-2846bbce-4e35-4a5f-a48f-473ae429b3b0 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1006.361177] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1006.361521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.361649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.361718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.361916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.362723] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.362972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.363092] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.363298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.363421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.364293] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.806087] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-513b77c4-be74-4b10-b343-748e8083d276 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1006.806636] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1006.806940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.809618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.869544] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.869639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.869712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.869986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.870117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.870793] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.870793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.870793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.870793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.870793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.870793] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1006.913081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.913081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.913081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.913081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.913081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.925009] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1007.230935] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-341 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.231208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-341" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.231304] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-341" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.231631] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-341" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.231898] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.232459] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.232619] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.232906] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.233069] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.233286] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.233399] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.233504] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.233610] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.233716] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.233951] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.234073] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.254191] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.254431] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1007.254476] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.254645] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-341" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.254996] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.255262] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.255386] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.255708] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.255847] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2fb0e81-edb4-4f79-85f6-f6817e7b7032',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.454998] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: SUCCESS [ 1007.455497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.758071] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.758291] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.758422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.758752] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.758852] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.758993] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port f2fb0e81-edb4-4f79-85f6-f6817e7b7032 not found, creating... [ 1007.759267] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.759421] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.759533] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.759863] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.759934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.760183] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.760334] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.760578] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.760639] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.760753] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.760889] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: f2fb0e81-edb4-4f79-85f6-f6817e7b7032 is going to be created. [ 1007.807457] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.807726] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.807913] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.808280] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.808513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.808839] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.502835] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-341a34d9-6900-43b9-a309-c264ea493706 service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 1008.503096] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-341a34d9-6900-43b9-a309-c264ea493706 service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1008.503221] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-341a34d9-6900-43b9-a309-c264ea493706 service nova] Enqueued Resource ID: f2fb0e81-edb4-4f79-85f6-f6817e7b7032 with Priority: HIGHEST for action port [ 1008.504024] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 1008.504168] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1008.504270] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2fb0e81-edb4-4f79-85f6-f6817e7b7032 with Priority: HIGHEST for action port [ 1008.504553] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.504693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.504747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.504931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.505024] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.506429] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.506527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.507115] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.507253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.507322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.508041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.508041] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2fb0e81-edb4-4f79-85f6-f6817e7b7032',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.937955] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1008.937955] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a deletion is rescheduled due to dependency. [ 1008.937955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.937955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.937955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.937955] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.937955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.937955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.937955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.937955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.937955] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.979830] env[65788]: INFO networking_nsxv3.common.synchronization [req-37aac870-2326-4191-be46-2b0414ab65b5 req-06af5f74-cb27-4252-80a7-eaf01361eac1 tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_members [ 1008.980833] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_members [ 1008.982029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.982029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.982029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.982029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.982029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.982029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.982029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.982392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.982392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.982392] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.007204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.007341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.010791] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2fb0e81-edb4-4f79-85f6-f6817e7b7032 with status ACTIVE [ 1009.010791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.010791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.010791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.010791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.010791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.010791] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.010791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.011191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.011191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.011257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.011658] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.011658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.011658] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.011826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.011826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.011826] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2fb0e81-edb4-4f79-85f6-f6817e7b7032 is going to be updated. [ 1009.033918] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.034057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.034104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.034295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.034439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.034600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2fb0e81-edb4-4f79-85f6-f6817e7b7032" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.385129] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.385370] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.385589] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.385964] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.386291] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.386492] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.386641] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.386930] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.387094] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.387335] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.387486] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.387614] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.387747] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.387885] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.388023] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.388185] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.390682] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.390941] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-939" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.391079] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-939" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.391387] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-939" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.391671] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.391864] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.392017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.392263] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.392438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.392651] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.392808] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.392957] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.393108] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.393248] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.393383] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.393548] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.441837] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.464606] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.464788] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.077 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.464960] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.465274] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.465629] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-be4bf5b3-1533-4950-9d3c-a0ae134f6345 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.465916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.465916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.466427] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.466427] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be4bf5b3-1533-4950-9d3c-a0ae134f6345',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.468702] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.468864] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.075 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.469011] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.469837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-939" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.470446] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-9f70c0da-f183-49ad-b7bc-e895c4286c58 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.471275] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.471275] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.471275] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.471450] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f70c0da-f183-49ad-b7bc-e895c4286c58',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.485504] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.485643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.485732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.485932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.487034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.487034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.487034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.487034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.487034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.487034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.487034] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd already deleted. [ 1009.487034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.944904] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.969190] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.969465] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.969551] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.969841] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.970048] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.970198] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port be4bf5b3-1533-4950-9d3c-a0ae134f6345 not found, creating... [ 1009.970479] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.970639] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.970779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.971231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.971231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.971476] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.971643] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.971729] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.971937] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.972104] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.972259] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: be4bf5b3-1533-4950-9d3c-a0ae134f6345 is going to be created. [ 1009.973919] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.974151] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.974265] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.974488] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.974637] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.974840] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 9f70c0da-f183-49ad-b7bc-e895c4286c58 not found, creating... [ 1009.975040] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.975222] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.975342] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.975543] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.975674] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.975960] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.976418] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.977032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.977032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.977032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.977214] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 9f70c0da-f183-49ad-b7bc-e895c4286c58 is going to be created. [ 1009.997192] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.997423] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.997560] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.997951] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.998095] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.998406] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.000201] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.000377] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.000510] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.000764] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.000969] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.001205] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.448250] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.448468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.448543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.448769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.448860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.448956] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1010.480780] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.480780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.481163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.481163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.481283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.490222] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1010.656979] env[65788]: INFO networking_nsxv3.common.synchronization [req-37aac870-2326-4191-be46-2b0414ab65b5 req-27d0607c-2252-4d38-9d27-6fa365ff8931 service nova] Enqueued Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_rules [ 1010.657182] env[65788]: INFO networking_nsxv3.common.synchronization [req-37aac870-2326-4191-be46-2b0414ab65b5 req-27d0607c-2252-4d38-9d27-6fa365ff8931 service nova] Enqueued Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_members [ 1010.657320] env[65788]: INFO networking_nsxv3.common.synchronization [req-37aac870-2326-4191-be46-2b0414ab65b5 req-27d0607c-2252-4d38-9d27-6fa365ff8931 service nova] Enqueued Resource ID: be4bf5b3-1533-4950-9d3c-a0ae134f6345 with Priority: HIGHEST for action port [ 1010.658097] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-ba43b6ed-b66c-4d76-9eac-c2c9a12c6ff1 service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 1010.658268] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-ba43b6ed-b66c-4d76-9eac-c2c9a12c6ff1 service nova] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1010.658426] env[65788]: INFO networking_nsxv3.common.synchronization [req-7671bdd2-2652-41b2-8725-b1acd062edf5 req-ba43b6ed-b66c-4d76-9eac-c2c9a12c6ff1 service nova] Enqueued Resource ID: 9f70c0da-f183-49ad-b7bc-e895c4286c58 with Priority: HIGHEST for action port [ 1010.660583] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_rules [ 1010.660583] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be4bf5b3-1533-4950-9d3c-a0ae134f6345 with Priority: HIGHEST for action port [ 1010.660583] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f70c0da-f183-49ad-b7bc-e895c4286c58 with Priority: HIGHEST for action port [ 1010.660583] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1010.660583] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_members [ 1010.660583] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_rules [ 1010.660583] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.660583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.660583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.660583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.660583] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.661275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-be4bf5b3-1533-4950-9d3c-a0ae134f6345 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.661275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.661275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.661275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.661489] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be4bf5b3-1533-4950-9d3c-a0ae134f6345',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.662286] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f70c0da-f183-49ad-b7bc-e895c4286c58 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.662385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.662491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.662595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.662667] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f70c0da-f183-49ad-b7bc-e895c4286c58',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.663529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.663627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.664013] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.664013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.664013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.664179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.665243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.665243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.665243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.665243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.665243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.665243] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.667296] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.667296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.168284] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be4bf5b3-1533-4950-9d3c-a0ae134f6345 with status ACTIVE [ 1011.168613] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.168613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.168728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.169205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.169205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.169397] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.173207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.173207] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be4bf5b3-1533-4950-9d3c-a0ae134f6345 is going to be updated. [ 1011.173207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.173207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.173207] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f70c0da-f183-49ad-b7bc-e895c4286c58 with status ACTIVE [ 1011.173207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.173888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.174085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.174352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.174554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.174829] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.175089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.175247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.175474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.175662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.175934] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.176159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.176329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.176555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.176722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.176960] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f70c0da-f183-49ad-b7bc-e895c4286c58 is going to be updated. [ 1011.178707] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.205673] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.205673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.205673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.206097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.206454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.206960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be4bf5b3-1533-4950-9d3c-a0ae134f6345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.208512] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.208764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.208917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.209532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.209532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.209532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f70c0da-f183-49ad-b7bc-e895c4286c58" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.681845] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.185167] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.185528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.185528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.185641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.185797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.185949] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd is going to be created. [ 1012.212181] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.212181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.212181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.212181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.212181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.223166] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd in Status: UNINITIALIZED for 2s [ 1012.499716] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1012.500024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.500147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.500356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.500542] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.500660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.500735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.500891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.500978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.501094] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.006776] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.509867] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.532296] env[65788]: INFO networking_nsxv3.common.synchronization [req-b81d313e-45cb-4e02-a4c2-226f4b76933a req-09e5a77b-cf99-4123-a83f-35a5410cec3f tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1013.532296] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1013.532296] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.532296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.532296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.532884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.533213] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.533683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.533901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.534198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.534498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.534740] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.977470] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.977470] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.977470] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.977692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.977855] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.978039] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.978137] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.978343] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.978485] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.978690] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.978804] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.978914] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.979034] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.979146] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.979251] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.979390] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.000961] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.001197] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.001345] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.001535] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.001887] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.002062] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.002206] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.004522] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.004664] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd4ed7a-ff1d-426b-955a-0eab14af6bb8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.012882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.013096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.013164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.013321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.013422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.013517] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1014.037468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.037610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.037683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.037895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.037987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.038201] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.038303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.038361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.038674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.038674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.038674] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1014.060923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.060923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.060923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.060923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.061511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.071499] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1014.082311] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.082467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.082536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.083104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.083266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.093600] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1014.234152] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd in Status: SUCCESS [ 1014.234379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.234547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.234759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.234955] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.235098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.235180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.235322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.235397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.237475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.237475] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.507920] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.507920] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.508329] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.508495] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.508975] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.508975] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 not found, creating... [ 1014.509215] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.509441] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.509737] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.510958] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.511273] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.511808] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.512120] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.512360] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.512771] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.513123] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.513366] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 is going to be created. [ 1014.538476] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.539566] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.539566] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.541257] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.541653] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.542272] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.742347] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.244377] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3cbc514-ff92-430a-ae1a-316e49fc6bdd: rpc.has_security_group_logging(os_id): False [ 1015.272799] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.273059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.273059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.273251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.273342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.273716] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.273872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.273923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.274122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.274204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.274310] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd is going to be created. [ 1015.340173] env[65788]: INFO networking_nsxv3.common.synchronization [req-b81d313e-45cb-4e02-a4c2-226f4b76933a req-58b98265-d356-4af7-bfd6-32204ab624af service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 1015.340375] env[65788]: INFO networking_nsxv3.common.synchronization [req-b81d313e-45cb-4e02-a4c2-226f4b76933a req-58b98265-d356-4af7-bfd6-32204ab624af service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1015.340513] env[65788]: INFO networking_nsxv3.common.synchronization [req-b81d313e-45cb-4e02-a4c2-226f4b76933a req-58b98265-d356-4af7-bfd6-32204ab624af service nova] Enqueued Resource ID: 0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 with Priority: HIGHEST for action port [ 1015.342898] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 1015.342898] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1015.342898] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 with Priority: HIGHEST for action port [ 1015.343106] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.343189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.343259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.343525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.343564] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.344990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.345119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.345325] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.345419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.345488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.345683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.345766] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd4ed7a-ff1d-426b-955a-0eab14af6bb8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.360963] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.361210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.361254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.361461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.361645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.386621] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd in Status: IN_PROGRESS for 2s [ 1015.847955] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 with status ACTIVE [ 1015.848249] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.848380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.848446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.848643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.848735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.848919] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.849042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.849106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.849349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.849496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.849628] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.849730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.849797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.849949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.850051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.850136] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0dd4ed7a-ff1d-426b-955a-0eab14af6bb8 is going to be updated. [ 1015.851684] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.851780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.877138] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.877409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.877409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.877563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.877695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.877870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dd4ed7a-ff1d-426b-955a-0eab14af6bb8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.083779] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1016.083779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.083779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.084056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.084188] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.084315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.084380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.084537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.084644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.084697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.084801] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.085801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.086012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.086235] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.086406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.086406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.086535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.086719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.086719] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.114473] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1016.114658] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 1016.114774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.114937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.115206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.115390] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.115513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.115584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.115764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.115866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.115930] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.588757] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.589944] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.590116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.617793] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.091650] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.120155] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.399637] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd in Status: SUCCESS [ 1017.399938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.594676] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.594835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.594904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.595232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.595709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.595709] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1017.622639] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.623346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.623346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.623346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.623346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.624449] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1017.631856] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.631856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.631856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.631856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.631856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.639439] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1017.655453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.655604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.655670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.655879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.656569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.666222] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1018.007506] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1018.007670] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent loop - iteration:2 started [ 1018.963391] env[65788]: INFO networking_nsxv3.common.synchronization [req-e63dd568-1543-4e16-adee-1e5fd9163d56 req-249e53df-219e-4540-bb90-b960885bbf05 tempest-ListServerFiltersTestJSON-1726380347 tempest-ListServerFiltersTestJSON-1726380347-project-member] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1018.964017] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1018.964424] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.964640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.964640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.964897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.965086] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.965189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.965249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.965438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.965549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.965614] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.411089] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.411325] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.411461] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.411799] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.412130] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.412296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.412415] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.412648] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.412807] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.413075] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.413190] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.413300] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.413401] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.413511] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.413614] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.413746] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.439485] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.439722] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1019.439872] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.440106] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.440469] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.440704] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.440854] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.441391] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.441544] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.468639] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.468892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.468892] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.469128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.469221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.469443] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.469549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.469610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.469773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.469850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.469937] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 already deleted. [ 1019.470033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.649870] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1019.650167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.650310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.650527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.650718] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.650849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.650947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.651156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.651267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.651903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.651903] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.651903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.651903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.651903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.652140] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.652140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.652140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.652259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.652291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.652592] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.652699] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.683110] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1019.683374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.683553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.684651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.684651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.684651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.684651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.684651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.684651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.684651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.684651] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.945363] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.945363] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.945551] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.945777] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.945916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.946394] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e not found, creating... [ 1019.946394] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.946533] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.946631] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.947744] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.947744] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.947744] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.947744] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.947744] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.947744] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.948031] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.948031] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e is going to be created. [ 1019.969925] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.970316] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.970316] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.970827] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.970984] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.971231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.155466] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c86f5e-5e15-4193-915e-454c2a0bcd6a: rpc.has_security_group_logging(os_id): False [ 1020.181075] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.181075] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.181075] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.181075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.182138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.182138] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.182138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.182353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.182353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.182725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.182725] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1020.187505] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.187685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.187685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.187840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.188043] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.188155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.188235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.188831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.188831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.188831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.189154] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.189154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.189247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.189765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.189765] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.189765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.189765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.190176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.190176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.190176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.190176] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.271390] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.271390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.271390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.271390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.271765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.292252] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1020.317451] env[65788]: INFO networking_nsxv3.common.synchronization [req-772c65e2-83f4-44d2-9799-b15bb1d554f9 req-598550f4-1586-40cf-a6be-2d665620704f tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1020.318065] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1020.318398] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.318516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.318580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.318803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.318954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.319074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.319133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.319282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.319358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.319458] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.693117] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605d7441-fa35-48f3-be10-861643ff1c6c: rpc.has_security_group_logging(os_id): False [ 1020.714306] env[65788]: INFO networking_nsxv3.common.synchronization [req-e63dd568-1543-4e16-adee-1e5fd9163d56 req-fb4d7964-2ea5-42fb-bfb0-f163bc0a6cc6 service nova] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_rules [ 1020.714471] env[65788]: INFO networking_nsxv3.common.synchronization [req-e63dd568-1543-4e16-adee-1e5fd9163d56 req-fb4d7964-2ea5-42fb-bfb0-f163bc0a6cc6 service nova] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1020.714608] env[65788]: INFO networking_nsxv3.common.synchronization [req-e63dd568-1543-4e16-adee-1e5fd9163d56 req-fb4d7964-2ea5-42fb-bfb0-f163bc0a6cc6 service nova] Enqueued Resource ID: 6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e with Priority: HIGHEST for action port [ 1020.716296] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.716296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.716450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.716528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.716613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.716865] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.716991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.717153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.717413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.717523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.717728] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.717858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.717904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.718060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.718140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.718319] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.718572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.718572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.718673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.718673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.718743] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1020.720298] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_rules [ 1020.720516] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1020.720629] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e with Priority: HIGHEST for action port [ 1020.721039] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.721135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.721205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.721540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.721540] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.722562] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.722816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.722939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.723306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.723306] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.723605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.723605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.723605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.723605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.723760] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.725151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.727429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.727757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.728062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.728062] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.745196] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.745466] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.745935] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.745935] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.746370] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.746557] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.747269] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.747269] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.747269] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.747473] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.747554] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.747682] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.747786] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.747892] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.748025] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.748142] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.769922] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.770112] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.770249] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.770476] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.770826] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.771116] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.771305] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.771684] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.771859] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b2b0ec4-c321-4951-8563-fbb8ffe0cde8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.814103] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.814103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.814103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.814103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.814480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.822192] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.822374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.822516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.822780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.822961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.823358] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.823600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.823600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.823809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.823899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.824064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1020.838378] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1020.854160] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.855037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.855113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.855353] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.855502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.869274] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1021.230438] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.230867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.230867] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e with status ACTIVE [ 1021.230957] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.231145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.231215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.231711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.231837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.231998] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.232918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.232918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.232918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.232918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.232918] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.232918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.232918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.233277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.233277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.233277] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e is going to be updated. [ 1021.234496] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.278972] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.279284] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.279448] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.279795] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.279991] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.280325] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 not found, creating... [ 1021.280622] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.280771] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.280992] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.281177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.281361] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.281699] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.281864] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.282030] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.282252] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.282402] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.282560] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 is going to be created. [ 1021.284541] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.284661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.284713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.284870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.285015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.285182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b2cd2a3-13cc-4d16-a3d2-e29f2273ad5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.319265] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.319517] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.319909] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.320381] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.320914] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.321338] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.738372] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.064716] env[65788]: INFO networking_nsxv3.common.synchronization [req-772c65e2-83f4-44d2-9799-b15bb1d554f9 req-bfb0d07d-a034-4c05-8fb1-9a28ce573822 service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1022.064937] env[65788]: INFO networking_nsxv3.common.synchronization [req-772c65e2-83f4-44d2-9799-b15bb1d554f9 req-bfb0d07d-a034-4c05-8fb1-9a28ce573822 service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1022.065131] env[65788]: INFO networking_nsxv3.common.synchronization [req-772c65e2-83f4-44d2-9799-b15bb1d554f9 req-bfb0d07d-a034-4c05-8fb1-9a28ce573822 service nova] Enqueued Resource ID: 9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 with Priority: HIGHEST for action port [ 1022.065602] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1022.065744] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1022.065847] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 with Priority: HIGHEST for action port [ 1022.066375] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.066645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.066741] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.067100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.069016] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.070146] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.070958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.070958] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.070958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.070958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.070958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.071546] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b2b0ec4-c321-4951-8563-fbb8ffe0cde8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.243874] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.244218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.244218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.244344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.244433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.244533] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be created. [ 1022.271529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.271683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.271755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.271989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.272177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.283430] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: UNINITIALIZED for 2s [ 1022.310213] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1022.310447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.310635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.310970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.311083] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.573726] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.573726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.573900] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 with status ACTIVE [ 1022.574084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.575495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.575495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.575495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.575978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.575978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.575978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.575978] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b2b0ec4-c321-4951-8563-fbb8ffe0cde8 is going to be updated. [ 1022.600800] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.600800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.600980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.601361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.601578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.601862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b2b0ec4-c321-4951-8563-fbb8ffe0cde8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.813740] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.813949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.813949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.814250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.814484] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.814611] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.814675] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.814835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.814958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.815042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.815163] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.856725] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1022.856969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.878626] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1022.878864] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 deletion is rescheduled due to dependency. [ 1022.878990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.879210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.879482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.879632] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.879755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.879841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.880043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.880149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.880219] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.318860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.319169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.319169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.319380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.319526] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.319625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.319693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.319848] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.319946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.320046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.320198] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.320291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.320349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.320490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.320627] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.320718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.320784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.320921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.321708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.321708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.321708] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.383314] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.823432] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c86f5e-5e15-4193-915e-454c2a0bcd6a: rpc.has_security_group_logging(os_id): False [ 1023.844518] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.844934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.845057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.845392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.845498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.845758] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.846129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.846129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.846129] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.846350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.846399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.846469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.846525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.846707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.846815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.846971] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.847136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.847244] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.847480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.847582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.847673] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1023.885752] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.959600] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.959778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.959859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.960116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.960274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.988500] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1024.296055] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.296055] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.296055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.296055] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.391020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.391020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.391020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.391020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.391020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.391020] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1024.436860] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.436860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.436860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.436860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.436860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.445054] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1024.799671] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.799671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.799671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.799671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.799671] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.800104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.800104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.800206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.800206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.800308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.800483] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.800587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.800644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.800794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.801126] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.801435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.801527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.801707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.801794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.801886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.801997] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.307072] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e17b3806-a6cb-4d6d-91a2-9df7fad51245: rpc.has_security_group_logging(os_id): False [ 1025.329833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.329833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.329833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.330054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.330088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.330265] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.330364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.330580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.330633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.330681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.330865] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.331084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.331084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.331224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.331358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.331849] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.331849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.331849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.331849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.331849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.331849] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be created. [ 1025.342518] env[65788]: INFO networking_nsxv3.common.synchronization [req-cd972dd2-6f5a-4bcb-8dda-226a6cb8a4ca req-0fa097a8-9b88-46bd-897e-b27a133796a2 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1025.343358] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1025.343789] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.343921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.344385] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.344693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.344930] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.345100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.345181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.345432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.345798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.345798] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.420999] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.420999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.420999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.420999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.420999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.436320] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1025.569210] env[65788]: INFO networking_nsxv3.common.synchronization [req-cd972dd2-6f5a-4bcb-8dda-226a6cb8a4ca req-8279f082-f157-4e8c-873e-5f8a299fff64 tempest-ServersTestMultiNic-1307134812 tempest-ServersTestMultiNic-1307134812-project-member] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1025.569973] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGHEST for action security_group_members [ 1025.571027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.571027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.848180] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.007300] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1026.008027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.351456] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.457361] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1026.457665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.457779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.457976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.458164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.458487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.458487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.458595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.458634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.459194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.459194] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.854754] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.854919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.854978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.855230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.855318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.855423] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1026.887490] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.887701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.887773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.887965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.888261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.900163] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1026.961612] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.961782] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.961862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.962199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.962425] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.962546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.962665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.963069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.963193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.963291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.963477] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.963580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.963641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.963792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.963936] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.964053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.964116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.964235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.964314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.964397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.964486] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.451804] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1027.452044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.466642] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5: rpc.has_security_group_logging(os_id): False [ 1027.490429] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.490837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.490837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.491097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.491097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.492495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.492495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.492495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.492495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.492495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.492495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.492495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.492495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.494260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.494260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.494260] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.494260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.494260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.494260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.494260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.494260] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1027.564882] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.565235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.565235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.565454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.565728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.581152] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1027.599818] env[65788]: INFO networking_nsxv3.common.synchronization [None req-bac69e02-9cc7-4af7-b259-b17e2eaa807d tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1027.600428] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1027.600951] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.601343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.601468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.601719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.602607] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.603274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.603426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.603674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.603910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.604090] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.627619] env[65788]: INFO networking_nsxv3.common.synchronization [req-3823052f-bc26-4ec4-8ed6-e5a498ce6f12 req-46f9f4f0-fb06-4d45-b8f2-909602183451 tempest-ListServerFiltersTestJSON-1726380347 tempest-ListServerFiltersTestJSON-1726380347-project-member] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1027.628845] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1027.628845] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.628845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.629095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.629768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.629962] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.630142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.630222] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.630403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.630498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.630650] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.030391] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.031158] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.031158] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.031283] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.031519] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.031762] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.031913] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.032188] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.032361] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.032589] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.032711] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.032844] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.032964] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.033157] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.033327] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.033491] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.057394] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.057546] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1028.057696] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.057893] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.058298] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-cf538606-37ff-4956-bb69-2e80a6bcdfdd taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.058492] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.058612] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.058952] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.059116] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf538606-37ff-4956-bb69-2e80a6bcdfdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.107514] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.133353] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.363719] env[65788]: INFO networking_nsxv3.common.synchronization [req-2cd708f4-2222-42ce-b308-275a4c2f2c27 req-ec2a436a-6e71-490f-b693-846d890789e4 tempest-ServersNegativeTestJSON-1756087549 tempest-ServersNegativeTestJSON-1756087549-project-member] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 1028.364333] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGHEST for action security_group_members [ 1028.364647] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.364771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.364838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.365049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.365208] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.365307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.365397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.365533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.365615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.365707] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.562416] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.562844] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.562844] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.563085] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.563294] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.563453] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port cf538606-37ff-4956-bb69-2e80a6bcdfdd not found, creating... [ 1028.563725] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.563888] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.564013] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.564289] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.564434] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.564726] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.564886] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.565015] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.565696] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.565836] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.565980] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: cf538606-37ff-4956-bb69-2e80a6bcdfdd is going to be created. [ 1028.587317] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.587599] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.587704] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.587970] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.588277] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.588526] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.609490] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.635722] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.868525] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.868702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.868773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.868985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.869098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.869393] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.869393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.869548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.869603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.869928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.869928] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be updated. [ 1028.909049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.909288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.909288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.909469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.909615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.912232] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1028.912429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.912572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.912833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.913035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.913203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.913267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.913425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.913522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.913663] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.917568] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: IN_PROGRESS for 2s [ 1029.112051] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.112253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.112253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.112405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.112500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.112601] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1029.138173] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.138379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.138428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.138705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.138850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.138971] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1029.149052] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.149052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.149052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.149052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.149630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.158622] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1029.173524] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.173714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.173714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.173949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.174139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.184234] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1029.369016] env[65788]: INFO networking_nsxv3.common.synchronization [req-3823052f-bc26-4ec4-8ed6-e5a498ce6f12 req-7bc2678c-21ff-495a-9d12-e373f5ae9faa service nova] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_rules [ 1029.369210] env[65788]: INFO networking_nsxv3.common.synchronization [req-3823052f-bc26-4ec4-8ed6-e5a498ce6f12 req-7bc2678c-21ff-495a-9d12-e373f5ae9faa service nova] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1029.369350] env[65788]: INFO networking_nsxv3.common.synchronization [req-3823052f-bc26-4ec4-8ed6-e5a498ce6f12 req-7bc2678c-21ff-495a-9d12-e373f5ae9faa service nova] Enqueued Resource ID: cf538606-37ff-4956-bb69-2e80a6bcdfdd with Priority: HIGHEST for action port [ 1029.369879] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_rules [ 1029.370030] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1029.370131] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf538606-37ff-4956-bb69-2e80a6bcdfdd with Priority: HIGHEST for action port [ 1029.370422] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.370598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.370598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.370800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.370882] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.371742] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.371861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.372035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf538606-37ff-4956-bb69-2e80a6bcdfdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.372137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.372202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.372456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.372562] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf538606-37ff-4956-bb69-2e80a6bcdfdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.415861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.416090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.416214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.416370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.416496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.416732] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.416980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.416980] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.417134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.417282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.417451] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be updated. [ 1029.445620] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.445773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.445840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.446049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.446187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.457036] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: IN_PROGRESS for 2s [ 1029.600704] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1029.601101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.868452] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.868684] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.868812] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.869098] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.869373] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.869553] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.869683] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.869935] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.870427] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.870427] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.870546] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.870592] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.874030] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.874030] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.874030] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.874030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.874805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.874947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.875240] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf538606-37ff-4956-bb69-2e80a6bcdfdd with status ACTIVE [ 1029.875407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.875508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.875569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.875731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.875808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.875977] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.876073] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.876138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.876264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.876338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.876498] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.876582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.876649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.876763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.876831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.876906] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf538606-37ff-4956-bb69-2e80a6bcdfdd is going to be updated. [ 1029.896377] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.896569] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.896709] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.896883] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.897240] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-b7953d2c-9533-4566-8277-fc70fe115c85 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.897414] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.897531] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.897858] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.898268] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7953d2c-9533-4566-8277-fc70fe115c85',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.899521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.899657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.899713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.900239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.900239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.900239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf538606-37ff-4956-bb69-2e80a6bcdfdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.993194] env[65788]: INFO networking_nsxv3.common.synchronization [req-4511b137-c0c0-4772-80fb-c3f22207e5b5 req-68e3e24f-ed76-44e4-9d82-ac2835673726 tempest-ServerRescueTestJSON-116164819 tempest-ServerRescueTestJSON-116164819-project-member] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1029.994094] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1029.994094] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.994094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.994094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.994287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.994320] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.994439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.994509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.994674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.994764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.994859] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.389195] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.389397] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.389520] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.389837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.390113] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.390272] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.390386] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.390601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.390741] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.390943] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.391097] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.391222] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.391332] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.391443] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.391546] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.391676] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.401580] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.401828] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.402278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.402278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.402397] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.402470] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port b7953d2c-9533-4566-8277-fc70fe115c85 not found, creating... [ 1030.402730] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.402878] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.402992] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.403264] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.403380] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.403674] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.404137] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.404137] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.404364] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.404364] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.404436] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: b7953d2c-9533-4566-8277-fc70fe115c85 is going to be created. [ 1030.411297] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.411491] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.411652] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.411890] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-717" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.412366] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.412597] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.412764] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.413193] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.413372] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('345d52f7-ba91-4d33-8de4-aa19ed82cd4b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.432711] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.432912] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.433045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.433428] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.433681] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.433912] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.496528] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.916077] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.916485] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.916485] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.916730] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.916929] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.917129] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 345d52f7-ba91-4d33-8de4-aa19ed82cd4b not found, creating... [ 1030.917435] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.917665] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.917847] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.918157] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.918363] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.918723] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.918957] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.919147] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.919365] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.919534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.919748] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 345d52f7-ba91-4d33-8de4-aa19ed82cd4b is going to be created. [ 1030.931424] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 in Status: SUCCESS [ 1030.931589] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 deletion is rescheduled due to dependency. [ 1030.931704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.944901] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.945156] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.945268] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.945724] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.946017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.946254] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.999318] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.140838] env[65788]: INFO networking_nsxv3.common.synchronization [req-0d305d41-5c5e-447b-9278-3b8857f17f75 req-45392bdc-34dd-42e9-aadd-abc9d809d81d service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1031.141647] env[65788]: INFO networking_nsxv3.common.synchronization [req-0d305d41-5c5e-447b-9278-3b8857f17f75 req-45392bdc-34dd-42e9-aadd-abc9d809d81d service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1031.141857] env[65788]: INFO networking_nsxv3.common.synchronization [req-0d305d41-5c5e-447b-9278-3b8857f17f75 req-45392bdc-34dd-42e9-aadd-abc9d809d81d service nova] Enqueued Resource ID: b7953d2c-9533-4566-8277-fc70fe115c85 with Priority: HIGHEST for action port [ 1031.144845] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1031.144845] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1031.149707] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7953d2c-9533-4566-8277-fc70fe115c85 with Priority: HIGHEST for action port [ 1031.149707] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.149707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.149707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.149707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.149707] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.149707] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.149707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.149707] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7953d2c-9533-4566-8277-fc70fe115c85 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.149707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.149707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.149707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.149707] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7953d2c-9533-4566-8277-fc70fe115c85',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.169669] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1031.169899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.170343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.170551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.171547] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.171547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.171547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.171547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.171547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.171547] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.194555] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1031.194822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.195034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.195279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.195502] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.195631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.195698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.195859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.195942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.196058] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.473146] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a in Status: SUCCESS [ 1031.473146] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a deletion is rescheduled due to dependency. [ 1031.473264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.503156] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.503289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.503365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.503582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.503673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.503770] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be updated. [ 1031.535369] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.535369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.535369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.535369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.535369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.544138] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: IN_PROGRESS for 2s [ 1031.629625] env[65788]: INFO networking_nsxv3.common.synchronization [req-4511b137-c0c0-4772-80fb-c3f22207e5b5 req-ecd8a00b-b1f0-4cfd-af6b-180cced5b82b service nova] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_rules [ 1031.629751] env[65788]: INFO networking_nsxv3.common.synchronization [req-4511b137-c0c0-4772-80fb-c3f22207e5b5 req-ecd8a00b-b1f0-4cfd-af6b-180cced5b82b service nova] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1031.629892] env[65788]: INFO networking_nsxv3.common.synchronization [req-4511b137-c0c0-4772-80fb-c3f22207e5b5 req-ecd8a00b-b1f0-4cfd-af6b-180cced5b82b service nova] Enqueued Resource ID: 345d52f7-ba91-4d33-8de4-aa19ed82cd4b with Priority: HIGHEST for action port [ 1031.630445] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_rules [ 1031.630579] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1031.630675] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 345d52f7-ba91-4d33-8de4-aa19ed82cd4b with Priority: HIGHEST for action port [ 1031.630940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.632964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.633162] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.633389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.633481] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.634357] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.634461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.634653] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.634794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.634835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.635643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.635643] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('345d52f7-ba91-4d33-8de4-aa19ed82cd4b',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.653221] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7953d2c-9533-4566-8277-fc70fe115c85 with status ACTIVE [ 1031.654144] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.654144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.654144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.654144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.654144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.654144] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.654700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.654700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.654700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.654700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.654700] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.654700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.654904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.654904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.654963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.655046] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7953d2c-9533-4566-8277-fc70fe115c85 is going to be updated. [ 1031.656111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.656320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.673621] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.683012] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.683221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.683221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.683397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.683644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.683861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7953d2c-9533-4566-8277-fc70fe115c85" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.703453] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.137399] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.137738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.137788] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 345d52f7-ba91-4d33-8de4-aa19ed82cd4b with status ACTIVE [ 1032.137955] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.138076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.138152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.138420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.138530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.138769] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.138884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.138949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.139132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.139289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.139418] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.139523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.139681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.139744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.139804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.139899] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 345d52f7-ba91-4d33-8de4-aa19ed82cd4b is going to be updated. [ 1032.163685] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.163875] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.163922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.164172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.164359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.164543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-345d52f7-ba91-4d33-8de4-aa19ed82cd4b" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.177190] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.204423] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.489313] env[65788]: INFO networking_nsxv3.common.synchronization [req-b0fc70c0-dcbb-4c0e-9fe9-de74e7a07204 req-8a4a5fac-c15c-44be-9d44-0ced00bf1e96 tempest-ListServerFiltersTestJSON-1726380347 tempest-ListServerFiltersTestJSON-1726380347-project-member] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1032.489827] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1032.490033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.490194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.681927] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.681927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.681927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.681927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.681927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.681927] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1032.707982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.710478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.710634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.710908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.711035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.711193] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1032.718188] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.718972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.719152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.719577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.719847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.734037] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1032.756621] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.756781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.756828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.757694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.757694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.767168] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1032.830706] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.830706] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.830894] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.831061] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.831810] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.832036] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.832202] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.832456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.832636] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.832873] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.833031] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.833210] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.833359] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.833505] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.833636] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.833796] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.855332] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.855681] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.856009] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.856127] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-692" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.856486] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-315249b7-4aba-4b60-9dc0-6fd05403d088 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.857282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.857282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.857282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.858146] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('315249b7-4aba-4b60-9dc0-6fd05403d088',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.359849] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.360150] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.360196] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.360481] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.360629] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.360781] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 315249b7-4aba-4b60-9dc0-6fd05403d088 not found, creating... [ 1033.361048] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.361210] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.361325] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.361561] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.362322] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.362654] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.362822] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.362940] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.363354] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.365273] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.365273] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 315249b7-4aba-4b60-9dc0-6fd05403d088 is going to be created. [ 1033.382876] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.383091] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.383208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.383483] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.383774] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.384076] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.554816] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: SUCCESS [ 1033.555088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.555300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.555604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.555928] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.556127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.556253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.556487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.556621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.556750] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.060491] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.144933] env[65788]: INFO networking_nsxv3.common.synchronization [req-b0fc70c0-dcbb-4c0e-9fe9-de74e7a07204 req-c17c6c3a-43f0-4766-8e3b-44e830e99254 service nova] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_rules [ 1034.145218] env[65788]: INFO networking_nsxv3.common.synchronization [req-b0fc70c0-dcbb-4c0e-9fe9-de74e7a07204 req-c17c6c3a-43f0-4766-8e3b-44e830e99254 service nova] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1034.145426] env[65788]: INFO networking_nsxv3.common.synchronization [req-b0fc70c0-dcbb-4c0e-9fe9-de74e7a07204 req-c17c6c3a-43f0-4766-8e3b-44e830e99254 service nova] Enqueued Resource ID: 315249b7-4aba-4b60-9dc0-6fd05403d088 with Priority: HIGHEST for action port [ 1034.146454] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_rules [ 1034.146645] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1034.147061] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 315249b7-4aba-4b60-9dc0-6fd05403d088 with Priority: HIGHEST for action port [ 1034.147061] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.147486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.148011] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.148011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.148170] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-315249b7-4aba-4b60-9dc0-6fd05403d088 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.148492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.148492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.148492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.148740] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('315249b7-4aba-4b60-9dc0-6fd05403d088',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.565806] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.650408] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 315249b7-4aba-4b60-9dc0-6fd05403d088 with status ACTIVE [ 1034.650637] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.650780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.650840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.651161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.651312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.651468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.651578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.651620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.652487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.652487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.652487] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.652487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.652487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.652487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.652487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.652487] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 315249b7-4aba-4b60-9dc0-6fd05403d088 is going to be updated. [ 1034.681178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.681456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.682083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.682083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.682223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.682452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-315249b7-4aba-4b60-9dc0-6fd05403d088" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.747027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1034.747319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.747454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.747657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.747853] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.747971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.748059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.748215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.748296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.748383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.748606] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.781871] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1034.782106] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.782270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.782476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.782675] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.782812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.782847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.782995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.783084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.783221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.783326] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.785396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.785396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.785561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.785659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.785712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.785851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.785988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.786060] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.046477] env[65788]: INFO networking_nsxv3.common.synchronization [req-b223e115-737b-4ac9-a81c-edf03dbcd44e req-8bde4bd9-d02c-4f81-a372-6d1cc9e72c72 tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1035.047076] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1035.047409] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.047533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.047629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.047856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.048026] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.048137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.048197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.048355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.048443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.048536] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.067908] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.068122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.068194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.068401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.068489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.068740] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be updated. [ 1035.111288] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.111502] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.111550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.111727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.111875] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.129444] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: IN_PROGRESS for 2s [ 1035.250971] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.250971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.250971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.250971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.251378] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.251378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.251605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.251768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.251865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.251958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.252131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.252325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.252406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.252845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.252845] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.252845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.252845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.254401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.254401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.254401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.254401] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.286984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.286984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.288971] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.473825] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.473971] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.474111] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.474454] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.474735] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.474892] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.475016] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.475359] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.475429] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.475596] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.475701] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.475817] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.475923] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.476044] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.476150] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.476279] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.495743] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.495914] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.496067] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.496273] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.496607] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-b99a104d-e241-4b85-8dcf-050b7a9dd71e taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.496781] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.496898] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.497255] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.497375] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b99a104d-e241-4b85-8dcf-050b7a9dd71e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.550825] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.550992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.551126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.551328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.551405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.551611] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.551723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.551772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.551909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.551984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.552086] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1035.581358] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.581709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.581709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.581786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.582842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.592435] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1035.756656] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5: rpc.has_security_group_logging(os_id): False [ 1035.778835] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.779081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.779180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.779451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.779598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.780032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.780032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.780178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.780301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.780416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.780669] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.780778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.780851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.781154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.781263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.781506] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.781663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.781734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.781935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.782049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.782225] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1035.795211] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.856459] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.856678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.856678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.857157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.857157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.872575] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1035.999929] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.000257] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.000425] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.000756] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.000952] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.001168] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port b99a104d-e241-4b85-8dcf-050b7a9dd71e not found, creating... [ 1036.001696] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.001884] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.002082] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.002634] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.003030] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.003446] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.003749] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.003989] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.004342] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.004601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.004819] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: b99a104d-e241-4b85-8dcf-050b7a9dd71e is going to be created. [ 1036.028455] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.028942] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.029304] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.033018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.033018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.033018] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.298267] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.298267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.298267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.298645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.298645] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.298711] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1036.333647] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.333846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.333922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.334123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.334265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.344099] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1036.793406] env[65788]: INFO networking_nsxv3.common.synchronization [req-b223e115-737b-4ac9-a81c-edf03dbcd44e req-b804dc7f-118b-41bf-8443-b113167399b3 service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 1036.793406] env[65788]: INFO networking_nsxv3.common.synchronization [req-b223e115-737b-4ac9-a81c-edf03dbcd44e req-b804dc7f-118b-41bf-8443-b113167399b3 service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1036.793406] env[65788]: INFO networking_nsxv3.common.synchronization [req-b223e115-737b-4ac9-a81c-edf03dbcd44e req-b804dc7f-118b-41bf-8443-b113167399b3 service nova] Enqueued Resource ID: b99a104d-e241-4b85-8dcf-050b7a9dd71e with Priority: HIGHEST for action port [ 1036.793406] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 1036.793406] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1036.793406] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99a104d-e241-4b85-8dcf-050b7a9dd71e with Priority: HIGHEST for action port [ 1036.793406] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.793406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.793406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.793406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.793406] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.794542] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.794642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.794838] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b99a104d-e241-4b85-8dcf-050b7a9dd71e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.794934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.794994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.795182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.795252] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b99a104d-e241-4b85-8dcf-050b7a9dd71e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.140559] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: SUCCESS [ 1037.140841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.141563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.141826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.142090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.142254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.142338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.142534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.142656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.142755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.142850] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.298850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.300311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.300311] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b99a104d-e241-4b85-8dcf-050b7a9dd71e with status ACTIVE [ 1037.300311] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.300311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.300311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.300311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.300311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.300311] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.300311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.300311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.300992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.300992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.300992] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.300992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.300992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.300992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.300992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.301377] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b99a104d-e241-4b85-8dcf-050b7a9dd71e is going to be updated. [ 1037.323527] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.323609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.323647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.323973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.324063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.324318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b99a104d-e241-4b85-8dcf-050b7a9dd71e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.604021] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1037.605258] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 1037.605394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.605600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.605852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.606095] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.606262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.606337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.606533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.606620] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.606757] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.645869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.646081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.646164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.646427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.646669] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.646798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.646884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.647139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.647238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.647382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.647560] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.647675] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.647732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.647899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.648069] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.648170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.648228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.648361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.648434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.648540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.648616] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.816762] env[65788]: INFO networking_nsxv3.common.synchronization [req-52c796b6-47ef-43ed-a0d2-e297805188ee req-f533b371-eb01-4c35-84fe-d41be3a4bd59 tempest-ServerDiagnosticsNegativeTest-960015076 tempest-ServerDiagnosticsNegativeTest-960015076-project-member] Enqueued Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_members [ 1037.817378] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_members [ 1037.819237] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.820716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.820854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.821120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.821314] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.821465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.821465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.824497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.824623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.824778] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.891617] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1037.891617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.081783] env[65788]: INFO networking_nsxv3.common.synchronization [req-a1b89024-3514-4a7a-acad-42799c2782e4 req-189e9282-fa7e-4b0b-bc0a-791ce2b7a5c6 tempest-ListImageFiltersTestJSON-1319309490 tempest-ListImageFiltersTestJSON-1319309490-project-member] Enqueued Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 1038.083552] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 with Priority: HIGHEST for action security_group_members [ 1038.084302] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.084467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.084467] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.084875] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.085070] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.085274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.085348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.085603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.085737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.085907] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.109351] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.154360] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0192141c-b766-4f81-bfc9-7eab487b7c37: rpc.has_security_group_logging(os_id): False [ 1038.175509] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.175747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.175856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.176042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.176166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.176396] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.176503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.176574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.177824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.177824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.177824] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.177824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.177824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.177824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.177824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.178334] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.178334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.178334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.178556] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.178613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.178723] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be updated. [ 1038.283658] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.283812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.283919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.285674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.285674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.302425] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: IN_PROGRESS for 2s [ 1038.319439] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.319713] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.319807] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.320047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.320318] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.320485] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.320578] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.320798] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.320957] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.321266] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.321401] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.321401] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.321536] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.321595] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.321691] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.321822] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.327296] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.327438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.327513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.327739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.327823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.328109] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.328291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.328291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.328506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.328599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.328673] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88f7125-f153-4742-9c51-e6fc3dd936cc already deleted. [ 1038.328758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.349686] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.349872] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.350111] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.350399] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-877" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.350960] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-f48f64c1-fc1b-4b1e-844b-149b26889ff8 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.351281] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.351469] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.351975] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.352164] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48f64c1-fc1b-4b1e-844b-149b26889ff8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.358330] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1038.358511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.358740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.358965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.359289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.359289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.359432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.359568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.359775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.359943] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.590738] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.590738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.590738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.591990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.592235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.592465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.592576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.592633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.592816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.592897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.592987] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 is going to be updated. [ 1038.612064] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.624453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.624559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.624649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.624860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.625090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.636495] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: IN_PROGRESS for 2s [ 1038.855684] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.856039] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.856197] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.857344] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.857597] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.857803] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port f48f64c1-fc1b-4b1e-844b-149b26889ff8 not found, creating... [ 1038.858396] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.858651] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.858827] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.859150] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.859340] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.859715] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.859930] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.860235] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.860509] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.860717] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.860920] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: f48f64c1-fc1b-4b1e-844b-149b26889ff8 is going to be created. [ 1038.862261] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.884167] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.884483] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.884682] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.884991] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.885330] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.885611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.114731] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.114983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.115091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.115408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.115753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.116226] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1039.154084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.154084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.154084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.154084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.154084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.169335] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1039.365349] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.653552] env[65788]: INFO networking_nsxv3.common.synchronization [req-52c796b6-47ef-43ed-a0d2-e297805188ee req-c5881561-5f60-4080-97b1-b9f6fc032ecb service nova] Enqueued Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_rules [ 1039.654613] env[65788]: INFO networking_nsxv3.common.synchronization [req-52c796b6-47ef-43ed-a0d2-e297805188ee req-c5881561-5f60-4080-97b1-b9f6fc032ecb service nova] Enqueued Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_members [ 1039.654613] env[65788]: INFO networking_nsxv3.common.synchronization [req-52c796b6-47ef-43ed-a0d2-e297805188ee req-c5881561-5f60-4080-97b1-b9f6fc032ecb service nova] Enqueued Resource ID: f48f64c1-fc1b-4b1e-844b-149b26889ff8 with Priority: HIGHEST for action port [ 1039.654613] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_rules [ 1039.654613] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_members [ 1039.654613] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48f64c1-fc1b-4b1e-844b-149b26889ff8 with Priority: HIGHEST for action port [ 1039.654869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.654997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.655079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.655330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.655416] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.656306] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.656423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.656491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.656769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.656811] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.656900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.656963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.657146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.657235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.657284] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.658131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f48f64c1-fc1b-4b1e-844b-149b26889ff8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.658253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.658324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.659281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.659281] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48f64c1-fc1b-4b1e-844b-149b26889ff8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.868462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.871132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.871132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.871132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.871132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.871132] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1039.907883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.908132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.908226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.908490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.908785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.921682] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1040.161104] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.161104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.161104] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.162513] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f48f64c1-fc1b-4b1e-844b-149b26889ff8 with status ACTIVE [ 1040.163313] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.163313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.163313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.163313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.163535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.163535] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.163635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.163723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.163847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.163921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.164829] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.164985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.165033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.165762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.165762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.165762] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f48f64c1-fc1b-4b1e-844b-149b26889ff8 is going to be updated. [ 1040.187812] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.187812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.187812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.188898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.188898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.188898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f48f64c1-fc1b-4b1e-844b-149b26889ff8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.284449] env[65788]: INFO networking_nsxv3.common.synchronization [req-64c85445-e93c-407d-adf5-51f782b3c71d req-d78decf2-e84a-4184-b80d-608c56acbe4c tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_members [ 1040.284890] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGHEST for action security_group_members [ 1040.285906] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.285906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.285906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.285906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.285906] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.286134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.286134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.286357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.286421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.286529] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.321311] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: SUCCESS [ 1040.321776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.647794] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 in Status: SUCCESS [ 1040.647794] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30 deletion is rescheduled due to dependency. [ 1040.647794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.668205] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.789535] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.793021] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.793021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.793021] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 is going to be updated. [ 1040.836305] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.836305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.836305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.836305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.836305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.846861] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 in Status: IN_PROGRESS for 2s [ 1041.170500] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.170923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.170986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.171330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.171431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.172252] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88f7125-f153-4742-9c51-e6fc3dd936cc is going to be created. [ 1041.183762] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1041.183986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.184224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.184450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.184772] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.184932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.185023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.185177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.185249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.185375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.185681] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.200562] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.201304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.201304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.201655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.202367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.214586] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88f7125-f153-4742-9c51-e6fc3dd936cc in Status: UNINITIALIZED for 2s [ 1041.688643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.688643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.688812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.689093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.689387] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.689580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.689681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.689953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.690124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.690294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.690570] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.690733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.690840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.691337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.691648] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.691863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.692028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.692379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.692607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.693023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.694157] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.938665] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.938665] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.938665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.938665] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.940773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.941698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.942427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.942427] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.942427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.943496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.943932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.943932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.944108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.944108] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.198236] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f8fa77-dfd6-4877-84c2-f9760d23fdfb: rpc.has_security_group_logging(os_id): False [ 1042.217291] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.217434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.217434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.217616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.217709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.218019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.218076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.218126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.218285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.218363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.218883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.219027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.219075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.219261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.219346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.219545] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.219708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.219708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.219854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.219993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.221854] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1042.292159] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.292329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.292397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.292615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.292779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.310182] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1042.448387] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e17b3806-a6cb-4d6d-91a2-9df7fad51245: rpc.has_security_group_logging(os_id): False [ 1042.470131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.470365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.470365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.470616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.470752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.470925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.471037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.471156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.471537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.471626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.471833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.471935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.472042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.472206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.472295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.472527] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.472644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.472711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.472868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.472935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.473034] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1042.544590] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.544775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.544856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.545159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.545331] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.560459] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1042.858230] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 in Status: SUCCESS [ 1042.858434] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 deletion is rescheduled due to dependency. [ 1042.858584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.226252] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88f7125-f153-4742-9c51-e6fc3dd936cc in Status: SUCCESS [ 1043.226647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.226647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.227289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.227289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.227289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.227289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.227577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.227665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.227773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.227877] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.730716] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.730976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.730976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.731257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.731917] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.731917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.731917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.731917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.732159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.732159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.732256] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.732373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.732446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.732938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.732938] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.732938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.732938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.733153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.733247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.733365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.733474] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.028392] env[65788]: INFO networking_nsxv3.common.synchronization [req-f76a0836-b917-4ed0-8ee0-259a63e1d597 req-0098f73b-42c9-41ee-91ce-0d052a24dc7c tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1044.029116] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1044.029611] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.029753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.029929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.030330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.030501] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.030616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.030697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.030889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.030982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.031160] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.238561] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e88f7125-f153-4742-9c51-e6fc3dd936cc: rpc.has_security_group_logging(os_id): False [ 1044.269308] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.269533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.269533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.269743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.269839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.270098] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.270223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.270294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.270450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.270529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.270716] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.270812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.270877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.271060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.271161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.271348] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.271477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.271563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.271719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.271849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.271899] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e88f7125-f153-4742-9c51-e6fc3dd936cc is going to be created. [ 1044.328000] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1044.329098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.361412] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.361606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.361675] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.361926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.362197] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.377074] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e88f7125-f153-4742-9c51-e6fc3dd936cc in Status: IN_PROGRESS for 2s [ 1044.532590] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.533158] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.533158] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.533359] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.533602] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.533772] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.533906] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.534166] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.534328] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.534615] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.535753] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.535753] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.535753] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.535753] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.535753] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.535753] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.537329] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.569517] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.569993] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1044.569993] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.569993] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.570386] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.570552] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.570823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.571012] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.571152] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.575550] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1044.575961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.575961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.576187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.576404] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.824467] env[65788]: INFO networking_nsxv3.common.synchronization [req-a88f40d1-5fdf-4925-adc9-c2f3c1036789 req-47d9d7ee-88e4-4157-82ba-7d710a86dde9 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1044.825380] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1044.825879] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.826026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.826026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.826287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.826512] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.826657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.826747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.826953] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.827130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.827283] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.041412] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.075429] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.076081] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.076270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.076687] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.076803] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.077151] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 not found, creating... [ 1045.077502] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.077502] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.077713] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.077867] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.078025] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.078377] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.078610] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.078695] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.078870] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.079044] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.079160] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 is going to be created. [ 1045.080943] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.081190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.081352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.081654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.081968] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.082167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.082243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.082404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.083591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.083591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.083591] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.134513] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.134732] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.134892] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.135165] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.135610] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.135778] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.331178] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.543892] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.544196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.544291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.544597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.544780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.544966] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1045.577564] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.577905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.577999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.578277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.578528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.586847] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.587033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.587111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.587324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.587568] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.587671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.587671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.587809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.587896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.588010] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.588275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.588443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.589030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.589030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.589030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.589030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.589030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.589297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.589297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.589361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.589426] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.591586] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1045.636346] env[65788]: INFO networking_nsxv3.common.synchronization [None req-6a4f86c1-d823-4aed-8eab-967c0a7395a0 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1045.637145] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1045.637476] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.637692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.808906] env[65788]: INFO networking_nsxv3.common.synchronization [req-f76a0836-b917-4ed0-8ee0-259a63e1d597 req-ca8c50a9-ffb7-408a-9c60-d1a0676d7c3d service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 1045.809366] env[65788]: INFO networking_nsxv3.common.synchronization [req-f76a0836-b917-4ed0-8ee0-259a63e1d597 req-ca8c50a9-ffb7-408a-9c60-d1a0676d7c3d service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1045.809366] env[65788]: INFO networking_nsxv3.common.synchronization [req-f76a0836-b917-4ed0-8ee0-259a63e1d597 req-ca8c50a9-ffb7-408a-9c60-d1a0676d7c3d service nova] Enqueued Resource ID: d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 with Priority: HIGHEST for action port [ 1045.809924] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 1045.810593] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1045.810593] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 with Priority: HIGHEST for action port [ 1045.810593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.811269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.811269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.811535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.811604] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.812596] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.812903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.813023] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.813173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.813269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.813519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.814197] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.832664] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.096030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e17b3806-a6cb-4d6d-91a2-9df7fad51245: rpc.has_security_group_logging(os_id): False [ 1046.115605] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.116684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.116825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.117185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.117482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.117776] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.117901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.117967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.118423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.118665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.118759] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.118865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.118930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.119123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.119204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.119420] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.119529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.119575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.119717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.119793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.119913] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1046.212966] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.213134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.213203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.213588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.213740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.233346] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1046.316757] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.316969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.317297] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 with status ACTIVE [ 1046.317565] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.317709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.317802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.318466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.318581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.318751] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.318861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.318921] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.320019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.320019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.320019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.320019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.320019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.320019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.320019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.320019] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864 is going to be updated. [ 1046.335542] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.335990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.335990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.336087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.336138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.336456] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1046.351612] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.351612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.351612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.351612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.351906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.351906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0f3d9cd-0727-4ba3-9f1b-d32d3f1fa864" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.387975] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.388084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.388136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.388349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.388508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.399992] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e88f7125-f153-4742-9c51-e6fc3dd936cc in Status: SUCCESS [ 1046.399992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.403838] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1047.601759] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1047.602862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.602862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.602862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.602862] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.602862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.603148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.603148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.603148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.603495] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.105706] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.259116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1048.259378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.416157] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1048.416424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.417013] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.417271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.417494] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.417622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.417702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.417899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.417986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.418097] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.609398] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.922493] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.922493] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.922493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.923700] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1048.956544] env[65788]: INFO networking_nsxv3.common.synchronization [req-0f7864fd-9e3f-4f6d-9113-883e9260176b req-49c40879-94cb-4f6c-bbc2-c66d7ad6b24f tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_members [ 1048.957272] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGHEST for action security_group_members [ 1048.957577] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.957779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.957956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.958525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.958525] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.958749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.958803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.959028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.959167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.959307] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.963629] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.963629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.963629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.963629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.964369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.981076] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1049.114643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.114643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.114643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.114643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.114643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.114643] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1049.179531] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.179531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.179531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.179531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.179531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.193535] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1049.465146] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.465146] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.465146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.465146] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 is going to be updated. [ 1049.507032] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.507032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.507032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.507032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.507032] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.519992] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 in Status: IN_PROGRESS for 2s [ 1050.995579] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1050.995904] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 deletion is rescheduled due to dependency. [ 1050.995904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.207130] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1051.207387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.207633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.207909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.208131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.208279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.208348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.208565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.208737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.208832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.208948] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.294273] env[65788]: INFO networking_nsxv3.common.synchronization [req-db446eb7-9f4a-485e-92c1-e8d167b23d97 req-ad1a3c70-9cf2-458e-8354-d4052779e274 tempest-ServerDiagnosticsNegativeTest-960015076 tempest-ServerDiagnosticsNegativeTest-960015076-project-member] Enqueued Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_members [ 1051.295025] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGHEST for action security_group_members [ 1051.295321] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.295970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.295970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.295970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.295970] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.296209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.296209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.296420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.296533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.296632] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.530471] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 in Status: SUCCESS [ 1051.530628] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 deletion is rescheduled due to dependency. [ 1051.530710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.714663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.714663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.714663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.714663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.714663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.715358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.715358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.715358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.715358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.715358] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.798755] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.798755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.798960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.799047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.799157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.799570] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.799570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.799570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.799781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.799781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.799781] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88f7125-f153-4742-9c51-e6fc3dd936cc is going to be updated. [ 1051.803154] env[65788]: INFO networking_nsxv3.common.synchronization [req-619b8aa0-fa4c-43e7-bec9-b5746bd107df req-0fea0863-c2b7-410c-a933-dd2f67abbce5 tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1051.803898] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1051.804354] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.804463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.804541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.804736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.804921] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.805025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.805094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.805341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.805481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.805589] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.830864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.830864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.830864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.831103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.831174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.843835] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88f7125-f153-4742-9c51-e6fc3dd936cc in Status: IN_PROGRESS for 2s [ 1052.217748] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1: rpc.has_security_group_logging(os_id): False [ 1052.237181] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.237386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.237386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.238277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.238277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.238277] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.238277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.238277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.238277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.238277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.238993] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.238993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.238993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.238993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.238993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.239991] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.239991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.239991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.242136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.242136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.242136] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1052.309602] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.309602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.309981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.310118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.310213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.310442] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.310554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.310615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.310794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.310877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.310971] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1052.313908] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.314070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.314145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.314318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.314459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.349216] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1052.363585] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.363873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.363873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.363966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.364080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.373918] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1053.726246] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ab045994-5937-4927-90d3-b2e123f2a375 None None] Enqueued Resource ID: 44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3 with Priority: HIGHEST for action port [ 1053.726500] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3 with Priority: HIGHEST for action port [ 1053.727069] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.727191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.727256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.727513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.727600] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.856873] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e88f7125-f153-4742-9c51-e6fc3dd936cc in Status: SUCCESS [ 1053.856873] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e88f7125-f153-4742-9c51-e6fc3dd936cc deletion is rescheduled due to dependency. [ 1053.856873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.944384] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.944625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.944727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.944879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.945014] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.231436] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3 [ 1054.231436] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.231616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.231616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.232475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.232475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.232475] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3 already deleted. [ 1054.232475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44be0c16-92c4-4b38-9dc3-b92a3ab8dfc3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.370237] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1054.370237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.396049] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1054.396310] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 1054.396695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.446845] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.950680] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.453219] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1055.453390] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1056.489078] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.489399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.489399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.489548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.505660] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1056.506604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.507982] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1056.548036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.548243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.548243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.548451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.558455] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.559332] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1056.559432] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.559528] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1056.610168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.610168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.610168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.610446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.612054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.612193] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1056.693315] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.693521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.693521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.693761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.694081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.694377] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1056.732845] env[65788]: INFO networking_nsxv3.common.synchronization [None req-189dd301-a3d4-4065-bc79-4d56727943e3 None None] Enqueued Resource ID: 33a33b64-4fcd-434e-ba8c-1158c80dd6bb with Priority: HIGHEST for action port [ 1056.733564] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a33b64-4fcd-434e-ba8c-1158c80dd6bb with Priority: HIGHEST for action port [ 1056.733833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-33a33b64-4fcd-434e-ba8c-1158c80dd6bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.733961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33a33b64-4fcd-434e-ba8c-1158c80dd6bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.737224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33a33b64-4fcd-434e-ba8c-1158c80dd6bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.738574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33a33b64-4fcd-434e-ba8c-1158c80dd6bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.738574] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33a33b64-4fcd-434e-ba8c-1158c80dd6bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.778064] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.778270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.778524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.779425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.779524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.779812] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1056.779914] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d6c1f029-c9a0-40e2-afd5-a6e6e896f095', '7b366224-1a8e-4eba-8bca-4fdd69ef52e9', 'dbcb83c2-5239-4c9a-ba59-1206501032bb', '975f007e-412c-4399-9443-27166cb23d7c', 'e88f7125-f153-4742-9c51-e6fc3dd936cc', '05b88372-ae25-44bd-b47b-e818f59c5f00', '85cc8a8c-6f5e-4e6e-86f6-c1788101dc44', '7c9eb1a7-b6ab-4c36-9698-fa5d64155721', '428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e', '793b8c66-424d-4744-801e-0d08e132ad00', '657a43cf-f5af-40a8-8da7-615eb6b41a78', '5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec', '781561fb-bac5-4326-981f-498051ee7235', '764f3a47-7b97-412a-ab36-7fb97a84a17c', '78cf75a9-6fba-4c9b-bfad-3d1090cb819d', '471c938d-6085-49dc-9e65-e361b495b859', '4645a495-ab9e-4045-a0e7-2cc7302cf3e0', 'a4b5aad8-d35c-4b10-8b3c-acf71725fec6', '4e376ad0-b32e-42c7-bf20-bb1704f19ac8', '7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5', '43c86f5e-5e15-4193-915e-454c2a0bcd6a', '0192141c-b766-4f81-bfc9-7eab487b7c37', '312ecf31-d6a5-4636-8de5-71be8f37e76e', '1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1', '61c7676a-9165-4a1a-b58b-8faa9c5567b8', 'e17b3806-a6cb-4d6d-91a2-9df7fad51245', 'adb68513-ddb5-44a7-8610-69e7dc83ba07', 'd22e7a7e-27b7-45b2-ac98-bd568f361a92', '64f8fa77-dfd6-4877-84c2-f9760d23fdfb', '41bb08da-7387-43a0-b7d4-fffc0c3a3846', '2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30', '482328ee-c8ae-447e-af1f-c321cd088282', '6e122c7c-4854-48e9-8b30-d71e6fb4283b', 'b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf', 'e3cbc514-ff92-430a-ae1a-316e49fc6bdd', '88a0f6ea-2705-4f7e-89ce-48ee3f2db28c', '5d96e629-2a5d-4253-97dc-c6a3cd034461', '60331e89-d7f7-4118-84ff-3c2694ae8888', '1723657c-045d-4e76-905a-f1602b6cbec4', '605d7441-fa35-48f3-be10-861643ff1c6c', '900e89d4-a148-4692-80f4-3bd065e8007a', 'a40ffece-b7ec-436b-a9b9-603ca8f67c90', '07ea6710-254c-4bc8-955c-3558da8ea95b', 'e17bee3e-2368-47f5-851f-96deb4d04a56', '5c2d9519-fb22-49d0-a2e2-a6d300763f8c', '478cab84-cb72-4b89-ac1a-ce3970d7f356'} {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.780087] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1056.805590] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.805590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.805590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.805590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.805590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.805590] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1056.805590] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.805590] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1056.892569] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.892569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.892569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.892569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.892939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.893196] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1056.893294] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.893368] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1056.893411] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1056.893518] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1056.893649] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGH for action security_group_rules [ 1056.893999] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGH for action security_group_rules [ 1056.893999] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGH for action security_group_rules [ 1056.893999] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGH for action security_group_rules [ 1056.893999] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGH for action security_group_rules [ 1056.893999] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGH for action security_group_rules [ 1056.894397] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGH for action security_group_rules [ 1056.894397] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGH for action security_group_rules [ 1056.894397] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGH for action security_group_rules [ 1056.894397] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGH for action security_group_rules [ 1056.894397] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGH for action security_group_rules [ 1056.894582] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGH for action security_group_rules [ 1056.894617] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGH for action security_group_rules [ 1056.894785] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGH for action security_group_rules [ 1056.894841] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGH for action security_group_rules [ 1056.894916] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGH for action security_group_rules [ 1056.895035] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGH for action security_group_rules [ 1056.895126] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGH for action security_group_rules [ 1056.895196] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGH for action security_group_rules [ 1056.895288] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGH for action security_group_rules [ 1056.895440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.242279] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33a33b64-4fcd-434e-ba8c-1158c80dd6bb [ 1057.243223] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.243223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.243223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.243223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.243223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.243223] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33a33b64-4fcd-434e-ba8c-1158c80dd6bb already deleted. [ 1057.243223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33a33b64-4fcd-434e-ba8c-1158c80dd6bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.628995] env[65788]: INFO networking_nsxv3.common.synchronization [req-6171f41c-f692-47f1-9ebc-92ac3d975957 req-64c22c6e-c5a6-4a29-9a91-7fdb23fdb368 tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1059.633391] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1059.633682] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 with Priority: HIGH for action security_group_rules [ 1059.633856] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb83c2-5239-4c9a-ba59-1206501032bb with Priority: HIGH for action security_group_rules [ 1059.634072] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 with Priority: HIGH for action security_group_rules [ 1059.634290] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGH for action security_group_rules [ 1059.634423] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGH for action security_group_rules [ 1059.634537] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 with Priority: HIGH for action security_group_rules [ 1059.634654] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 with Priority: HIGH for action security_group_rules [ 1059.634805] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 with Priority: HIGH for action security_group_rules [ 1059.636015] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c with Priority: HIGH for action security_group_rules [ 1059.636540] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 471c938d-6085-49dc-9e65-e361b495b859 with Priority: HIGH for action security_group_rules [ 1059.636698] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781561fb-bac5-4326-981f-498051ee7235 with Priority: HIGH for action security_group_rules [ 1059.637076] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGH for action security_group_rules [ 1059.637076] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 with Priority: HIGH for action security_group_rules [ 1059.637076] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793b8c66-424d-4744-801e-0d08e132ad00 with Priority: HIGH for action security_group_rules [ 1059.637241] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e with Priority: HIGH for action security_group_rules [ 1059.637241] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 with Priority: HIGH for action security_group_rules [ 1059.637342] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 with Priority: HIGH for action security_group_rules [ 1059.638117] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88f7125-f153-4742-9c51-e6fc3dd936cc with Priority: HIGH for action security_group_rules [ 1059.638378] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGH for action security_group_rules [ 1059.638542] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGH for action security_group_rules [ 1059.638980] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.639203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.639299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.639661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.639879] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.640076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.640179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.640421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.640569] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.640713] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.641855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.642026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.642110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.642354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.642450] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c1f029-c9a0-40e2-afd5-a6e6e896f095',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.643638] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbcb83c2-5239-4c9a-ba59-1206501032bb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.643924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.644075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.644323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.644385] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbcb83c2-5239-4c9a-ba59-1206501032bb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.645519] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.645881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.645881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.647248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.647248] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cc8a8c-6f5e-4e6e-86f6-c1788101dc44',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.647732] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.647883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.648288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.648288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.648288] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.649721] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.649721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.649721] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.651061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.651061] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.651061] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.651061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.651437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.651437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.651437] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e376ad0-b32e-42c7-bf20-bb1704f19ac8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.652319] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.652500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.652577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.652835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.652949] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4b5aad8-d35c-4b10-8b3c-acf71725fec6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.653949] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.654093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.654163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.654340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.654431] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4645a495-ab9e-4045-a0e7-2cc7302cf3e0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.655650] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-764f3a47-7b97-412a-ab36-7fb97a84a17c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.655784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.655850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.656432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.656432] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('764f3a47-7b97-412a-ab36-7fb97a84a17c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.656970] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-471c938d-6085-49dc-9e65-e361b495b859 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.657133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.657258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.657440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.657659] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('471c938d-6085-49dc-9e65-e361b495b859',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.658663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781561fb-bac5-4326-981f-498051ee7235 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.658806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.658868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.659125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.659190] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781561fb-bac5-4326-981f-498051ee7235',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.660419] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.660598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.660705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.661067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.661067] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.662428] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-657a43cf-f5af-40a8-8da7-615eb6b41a78 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.662428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.662428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.663174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.663289] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('657a43cf-f5af-40a8-8da7-615eb6b41a78',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.664537] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-793b8c66-424d-4744-801e-0d08e132ad00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.664777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.664934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.665349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.665349] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('793b8c66-424d-4744-801e-0d08e132ad00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.666269] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.666376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.666468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.667912] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.668773] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.668922] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b88372-ae25-44bd-b47b-e818f59c5f00 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.668922] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.669041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.669185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.669248] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b88372-ae25-44bd-b47b-e818f59c5f00',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.669954] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.670084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.670235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.670301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.670375] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c9eb1a7-b6ab-4c36-9698-fa5d64155721',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.671297] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e88f7125-f153-4742-9c51-e6fc3dd936cc taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.673217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.673217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.673217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.673217] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e88f7125-f153-4742-9c51-e6fc3dd936cc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.673217] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.673217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.673217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.673217] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.673634] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.674507] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.674717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.674717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.674862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.674946] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.680690] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.714116] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.714116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.714116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.714524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.718471] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.718615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.741943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.741943] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c1f029-c9a0-40e2-afd5-a6e6e896f095 is going to be deleted. [ 1059.741943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.741943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.764287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.764460] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbcb83c2-5239-4c9a-ba59-1206501032bb is going to be deleted. [ 1059.824691] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.825034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.825034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.825247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.825349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.825506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c1f029-c9a0-40e2-afd5-a6e6e896f095" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.892126] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.892126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.892126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.892126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.892126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.892126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbcb83c2-5239-4c9a-ba59-1206501032bb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.180692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.180692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.180692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.180855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.180984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.181089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.181089] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.181236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.181329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.181414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.181516] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.182473] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.182598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.182775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.182834] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.182925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.183025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.183085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.183219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.183295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.183428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.183484] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.195593] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.195809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.195809] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.196058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.196229] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.196331] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.196395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.196549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.196631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.196717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.196801] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.208546] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.251651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.251651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.251651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.251651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.306932] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.306932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.306932] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.306932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.306932] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.306932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.306932] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.306932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.307577] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.307577] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.308351] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.308477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.309107] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.309259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.309877] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.310031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.310692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.310808] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.311570] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.311695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.312260] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.312738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.312877] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781561fb-bac5-4326-981f-498051ee7235 is going to be deleted. [ 1060.313858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.314166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.317060] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.317060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.317524] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.317664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.318789] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.319234] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.319628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.319958] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.320731] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.320731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.339838] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.340623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.340798] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b88372-ae25-44bd-b47b-e818f59c5f00 is going to be deleted. [ 1060.341779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.342130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.363222] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.363356] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 764f3a47-7b97-412a-ab36-7fb97a84a17c is going to be deleted. [ 1060.364464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.364610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.389118] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.389374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.390418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.390524] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4b5aad8-d35c-4b10-8b3c-acf71725fec6 is going to be deleted. [ 1060.391477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.392560] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.415591] env[65788]: INFO networking_nsxv3.common.synchronization [None req-a5610e42-1bfe-4f4f-b1b9-3277269dfe94 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1060.416918] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1060.416918] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.416918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.416918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.416918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.417260] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.422754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.422754] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be deleted. [ 1060.424544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.424544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.428133] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.428219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.433282] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.433282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.478472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.478613] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cc8a8c-6f5e-4e6e-86f6-c1788101dc44 is going to be deleted. [ 1060.479568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.479792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.503212] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.503212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.527851] env[65788]: INFO networking_nsxv3.common.synchronization [None req-53279217-25c2-4272-b220-66c22d3f9b63 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1060.528728] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1060.529072] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.529219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.576420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.576657] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e88f7125-f153-4742-9c51-e6fc3dd936cc is going to be deleted. [ 1060.579043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.579043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.610417] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.611079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.626543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.626543] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be deleted. [ 1060.626846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.626911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.628734] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.628927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.660095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.660645] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4645a495-ab9e-4045-a0e7-2cc7302cf3e0 is going to be deleted. [ 1060.662426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.662790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.687023] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.688112] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.703915] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.716781] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.716946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.717027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.717275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.717367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.717479] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1060.720261] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.720384] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.735599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.735803] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e is going to be deleted. [ 1060.736786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.736934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.750413] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.750690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.794595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.794971] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 793b8c66-424d-4744-801e-0d08e132ad00 is going to be deleted. [ 1060.797059] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.797227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.799207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.799403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.799403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.799662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.799828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.842601] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.842850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.858995] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1060.868240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.868458] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e376ad0-b32e-42c7-bf20-bb1704f19ac8 is going to be deleted. [ 1060.870183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.870377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.936836] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.937020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.966900] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.967074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.974046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.974046] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 471c938d-6085-49dc-9e65-e361b495b859 is going to be deleted. [ 1060.974584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.974814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.036595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.036776] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c9eb1a7-b6ab-4c36-9698-fa5d64155721 is going to be deleted. [ 1061.037729] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.038631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.039676] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.039801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.080739] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.080844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.091274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.091456] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 657a43cf-f5af-40a8-8da7-615eb6b41a78 is going to be deleted. [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781561fb-bac5-4326-981f-498051ee7235" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b88372-ae25-44bd-b47b-e818f59c5f00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-764f3a47-7b97-412a-ab36-7fb97a84a17c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.095090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4b5aad8-d35c-4b10-8b3c-acf71725fec6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cc8a8c-6f5e-4e6e-86f6-c1788101dc44" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e88f7125-f153-4742-9c51-e6fc3dd936cc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.097643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.097643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.097643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.097643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4645a495-ab9e-4045-a0e7-2cc7302cf3e0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.097643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.097643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.097643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.097982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-428cec0b-0a60-4542-8b8a-f6a0d2d6fe5e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.097982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.097982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.098091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.098122] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c already deleted. [ 1061.098247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.098678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.098678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.098678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.098678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e376ad0-b32e-42c7-bf20-bb1704f19ac8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.098812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.098895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.098975] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.100242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.100242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.100377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.100441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-471c938d-6085-49dc-9e65-e361b495b859" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.139633] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.139633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.139633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.139900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.139900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.139968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-793b8c66-424d-4744-801e-0d08e132ad00" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.174927] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.175105] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.175163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.175356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.175444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.175574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c9eb1a7-b6ab-4c36-9698-fa5d64155721" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.189694] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b366224-1a8e-4eba-8bca-4fdd69ef52e9: rpc.has_security_group_logging(os_id): False [ 1061.191385] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec: rpc.has_security_group_logging(os_id): False [ 1061.207017] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78cf75a9-6fba-4c9b-bfad-3d1090cb819d: rpc.has_security_group_logging(os_id): False [ 1061.262315] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.262484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.262540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.262773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.264722] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.264945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.266494] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.266596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.271708] env[65788]: INFO networking_nsxv3.common.synchronization [req-71f04ebd-b3ed-4782-ab06-7a11bcef7f32 req-63be685c-00c7-4c5c-9ed9-a6cf814415b5 tempest-ServerRescueTestJSON-116164819 tempest-ServerRescueTestJSON-116164819-project-member] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1061.272208] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1061.272525] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.272649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.272724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.272905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.273085] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.273187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.273248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.273392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.273475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.273572] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.282861] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.283058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.336210] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.336746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.337085] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.337303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.337303] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.337453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.337532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.337672] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1061.338970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.339637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.378274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.378274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.378274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.378274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.378274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.378274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.378274] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1061.379239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.379461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.379571] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.379608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-657a43cf-f5af-40a8-8da7-615eb6b41a78" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.379914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.380451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.437536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.437805] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.437933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.437999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.438273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.438361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.438622] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 is going to be updated. [ 1061.529602] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.530413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.530510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.530718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.530896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.545736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.545965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.545965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.546183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.546324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.561308] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.561452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.561525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.561860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.562077] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.566216] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: IN_PROGRESS for 2s [ 1061.567113] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1061.603743] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1061.651760] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.652174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.652734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.652965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.653124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.653193] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c already deleted. [ 1061.653296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.775921] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.278733] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.782189] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.784972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.784972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.784972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.784972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.784972] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be updated. [ 1062.820780] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.820972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.821123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.821379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.821609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.834905] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: IN_PROGRESS for 2s [ 1062.870292] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1062.872133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.154709] env[65788]: INFO networking_nsxv3.common.synchronization [req-944a983b-2ed4-4213-9471-3ae085df81e3 req-1cea2e82-18cc-4cfe-af8f-6cef88d8cf2d tempest-ListServerFiltersTestJSON-1726380347 tempest-ListServerFiltersTestJSON-1726380347-project-member] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1063.155337] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1063.155651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.155766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.155832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.156039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.156207] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.156308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.156370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.156513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.156680] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.156731] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.589766] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1063.589928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.590955] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: SUCCESS [ 1063.590955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.623904] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1063.623904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.659411] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.163266] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.666444] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.666643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.666719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.666983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.667095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.667199] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1064.701663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.701867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.701946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.702239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.702401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.719356] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1064.849027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: SUCCESS [ 1064.849307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.304977] env[65788]: INFO networking_nsxv3.common.synchronization [None req-ab2adf14-292f-4158-9fca-d49265169971 None None] Enqueued Resource ID: 8c0d358d-dec2-4c44-bd9c-6ec83581c4e6 with Priority: HIGHEST for action port [ 1065.305630] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c0d358d-dec2-4c44-bd9c-6ec83581c4e6 with Priority: HIGHEST for action port [ 1065.306280] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c0d358d-dec2-4c44-bd9c-6ec83581c4e6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.306280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c0d358d-dec2-4c44-bd9c-6ec83581c4e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.306280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c0d358d-dec2-4c44-bd9c-6ec83581c4e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.306803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c0d358d-dec2-4c44-bd9c-6ec83581c4e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.306803] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c0d358d-dec2-4c44-bd9c-6ec83581c4e6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.810143] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c0d358d-dec2-4c44-bd9c-6ec83581c4e6 [ 1065.810143] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.810143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.810143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.810143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.810143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.810143] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c0d358d-dec2-4c44-bd9c-6ec83581c4e6 already deleted. [ 1065.810143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c0d358d-dec2-4c44-bd9c-6ec83581c4e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.267060] env[65788]: INFO networking_nsxv3.common.synchronization [None req-23f2d5a5-eb65-41ee-ace9-ad135fd647c0 tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1066.267716] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1066.269084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.269245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.269315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.269573] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.269659] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.405311] env[65788]: INFO networking_nsxv3.common.synchronization [None req-97e6e534-3d71-4512-ba83-6f3158f60f6c tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1066.406033] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1066.406033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.406155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.736683] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1066.737112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.791815] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.792050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.792098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.792421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.792526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.792818] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45f89b37-71e4-413c-a620-b4180609f205 already deleted. [ 1066.792818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.792928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.793140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.793260] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.314874] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.314874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.314874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.314874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.314874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.314874] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45f89b37-71e4-413c-a620-b4180609f205 already deleted. [ 1067.314874] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.936715] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3200eeb7-5622-4de0-a246-66b39350948a None None] Enqueued Resource ID: 155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315 with Priority: HIGHEST for action port [ 1067.937396] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315 with Priority: HIGHEST for action port [ 1067.937727] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.938281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.938399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.938998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.938998] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.229029] env[65788]: INFO networking_nsxv3.common.synchronization [req-e471e6a4-fb9b-4508-8a03-04b5ed20296f req-79286c7c-ec78-4f98-a494-87a50dcce37c tempest-ServerAddressesTestJSON-1371429517 tempest-ServerAddressesTestJSON-1371429517-project-member] Enqueued Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_members [ 1068.229218] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_members [ 1068.229580] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.229710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.229813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.230280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.230468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.230592] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.230699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.230928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.231100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.231227] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.441876] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315 [ 1068.442211] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.442373] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.442435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.442694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.442796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.442900] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315 already deleted. [ 1068.442984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-155b2e2c-9fb0-4d6e-a46f-eb0dc98d5315" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.548629] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.548826] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.549021] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.549305] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.549562] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.549717] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.549831] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.555032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.555032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.555032] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.555032] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.555032] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.555032] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.555032] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.555032] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.555032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.576740] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.576899] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.577366] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.577366] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-257" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.577549] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-280f4758-112f-490f-bfa2-ec1978654c07 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.577710] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.579080] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.579080] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.579080] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('280f4758-112f-490f-bfa2-ec1978654c07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.733090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.733296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.733346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.733532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.733691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.733844] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.734065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.734065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.734745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.734745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.734745] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ded108-574f-4c27-b008-f6c2b759b560 already deleted. [ 1068.734745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.083091] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.083091] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.083584] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.083584] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.083671] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.083821] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 280f4758-112f-490f-bfa2-ec1978654c07 not found, creating... [ 1069.084103] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.084280] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.084564] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.084853] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.085011] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.085334] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.085485] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.085601] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.085811] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.085949] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.086094] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 280f4758-112f-490f-bfa2-ec1978654c07 is going to be created. [ 1069.108960] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.109236] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.109361] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.109656] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.109917] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.110212] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.833331] env[65788]: INFO networking_nsxv3.common.synchronization [req-e471e6a4-fb9b-4508-8a03-04b5ed20296f req-9a8c1654-8b51-4a75-afc0-b89129c6c320 service nova] Enqueued Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_rules [ 1069.833331] env[65788]: INFO networking_nsxv3.common.synchronization [req-e471e6a4-fb9b-4508-8a03-04b5ed20296f req-9a8c1654-8b51-4a75-afc0-b89129c6c320 service nova] Enqueued Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_members [ 1069.833641] env[65788]: INFO networking_nsxv3.common.synchronization [req-e471e6a4-fb9b-4508-8a03-04b5ed20296f req-9a8c1654-8b51-4a75-afc0-b89129c6c320 service nova] Enqueued Resource ID: 280f4758-112f-490f-bfa2-ec1978654c07 with Priority: HIGHEST for action port [ 1069.834589] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_rules [ 1069.834765] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_members [ 1069.834974] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280f4758-112f-490f-bfa2-ec1978654c07 with Priority: HIGHEST for action port [ 1069.835887] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.835887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.835887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.836124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.836172] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.838718] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.838841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.839160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.839160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.839310] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.840591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.841899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.841899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.841899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.841899] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.842234] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-280f4758-112f-490f-bfa2-ec1978654c07 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.842234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.842332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.842451] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.842531] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('280f4758-112f-490f-bfa2-ec1978654c07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.339304] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.339304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.348025] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.348025] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 280f4758-112f-490f-bfa2-ec1978654c07 with status ACTIVE [ 1070.348025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.348025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.348025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.348025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.348772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.348772] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 280f4758-112f-490f-bfa2-ec1978654c07 is going to be updated. [ 1070.374026] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.374026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.374026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.374294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.374505] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.374863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-280f4758-112f-490f-bfa2-ec1978654c07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.850972] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.046683] env[65788]: INFO networking_nsxv3.common.synchronization [req-3477abdf-5141-4d65-8772-ce03bd5c7c5b req-7c9217ba-14ed-4552-96b9-510a67cc1dce tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 1071.047274] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 1071.047579] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.047701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.047768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.047962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.049274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.049393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.049460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.049621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.049723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.049790] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.353623] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.354072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.354072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.354163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.354238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.354343] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ded108-574f-4c27-b008-f6c2b759b560 is going to be created. [ 1071.376668] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.376870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.376870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.377135] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.377358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.384998] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.385263] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.385332] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.385578] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.385896] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.386115] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.386244] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.386457] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.386592] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.386798] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.386909] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.387045] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.387177] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.387289] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.387391] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.387522] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.389382] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ded108-574f-4c27-b008-f6c2b759b560 in Status: UNINITIALIZED for 2s [ 1071.407419] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.407419] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.407610] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.407828] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.408227] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-b3704f12-a32d-4311-b284-5412f0c5f8e6 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.408433] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.408585] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.408927] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.409079] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3704f12-a32d-4311-b284-5412f0c5f8e6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.552397] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.552397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.552579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.552694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.552747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.552955] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.553104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.553167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.553567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.553567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.553567] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be deleted. [ 1071.584134] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.584134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.584134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.584134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.584134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.584134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.911514] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.911823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.911944] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.912259] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.912460] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.912647] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port b3704f12-a32d-4311-b284-5412f0c5f8e6 not found, creating... [ 1071.912969] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.913230] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.913391] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.913656] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.913911] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.914280] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.914490] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.914636] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.914887] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.915064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.915240] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: b3704f12-a32d-4311-b284-5412f0c5f8e6 is going to be created. [ 1071.938419] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.938724] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.938950] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.939268] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.939537] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.939798] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.612019] env[65788]: INFO networking_nsxv3.common.synchronization [req-3477abdf-5141-4d65-8772-ce03bd5c7c5b req-2c9ecba6-d0a6-4805-ac57-7fb77f8bcf1e service nova] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_rules [ 1072.612019] env[65788]: INFO networking_nsxv3.common.synchronization [req-3477abdf-5141-4d65-8772-ce03bd5c7c5b req-2c9ecba6-d0a6-4805-ac57-7fb77f8bcf1e service nova] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 1072.612019] env[65788]: INFO networking_nsxv3.common.synchronization [req-3477abdf-5141-4d65-8772-ce03bd5c7c5b req-2c9ecba6-d0a6-4805-ac57-7fb77f8bcf1e service nova] Enqueued Resource ID: b3704f12-a32d-4311-b284-5412f0c5f8e6 with Priority: HIGHEST for action port [ 1072.612019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_rules [ 1072.612019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 1072.612019] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3704f12-a32d-4311-b284-5412f0c5f8e6 with Priority: HIGHEST for action port [ 1072.612019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.613085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.613307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.614098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.614098] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.615122] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.615236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.615302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.615452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.615600] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.615695] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.615756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.615893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.617759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.617759] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.617759] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3704f12-a32d-4311-b284-5412f0c5f8e6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.617759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.617759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.617759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.617759] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3704f12-a32d-4311-b284-5412f0c5f8e6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.119102] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.120562] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.120562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.120737] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3704f12-a32d-4311-b284-5412f0c5f8e6 with status ACTIVE [ 1073.120845] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.120967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.121103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.121316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.121472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.121649] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.121804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.122420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.122622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.122699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.123123] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.123123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.123225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.123419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.123473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.123530] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3704f12-a32d-4311-b284-5412f0c5f8e6 is going to be updated. [ 1073.146151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.146348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.146398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.146628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.146801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.147011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.400417] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ded108-574f-4c27-b008-f6c2b759b560 in Status: SUCCESS [ 1073.400417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.400565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.400772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.401018] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.401193] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.401283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.402169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.402169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.402169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.402169] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.626684] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.904894] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.905094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.905206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.905663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.905872] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.905991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.906076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.906271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.906381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.906484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.906727] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.906817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.906878] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.906989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.907148] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.907261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.907321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.908030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.908138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.908335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.908405] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.128683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.129710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.129710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.129910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.129910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.129997] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be created. [ 1074.155168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.155333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.155404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.155607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.155765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.168020] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: UNINITIALIZED for 2s [ 1074.410438] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2ded108-574f-4c27-b008-f6c2b759b560: rpc.has_security_group_logging(os_id): False [ 1074.428962] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.429161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.429272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.429644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.429835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.430168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.430377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.430499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.430754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.430881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.431221] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.431372] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.431448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.431625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.431720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.432090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.432214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.432299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.432498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.432584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.432677] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2ded108-574f-4c27-b008-f6c2b759b560 is going to be created. [ 1074.493071] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.493071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.493071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.493376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.493475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.507181] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2ded108-574f-4c27-b008-f6c2b759b560 in Status: IN_PROGRESS for 2s [ 1076.010820] env[65788]: INFO networking_nsxv3.common.synchronization [None req-91a07d57-bc02-4dae-a1aa-969366152a98 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_rules [ 1076.011536] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_rules [ 1076.011536] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.011740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.011740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.013070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.013070] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.140810] env[65788]: INFO networking_nsxv3.common.synchronization [None req-748ec39a-df0f-4ac7-8684-a3b9ba1fb6cb tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_rules [ 1076.141432] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_rules [ 1076.141862] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.141968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.181815] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: SUCCESS [ 1076.182163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.182439] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.182792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.183259] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.183453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.183489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.183719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.183802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.184021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.184139] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.526507] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2ded108-574f-4c27-b008-f6c2b759b560 in Status: SUCCESS [ 1076.528033] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.536251] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.536557] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.536637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.537066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.537329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.537416] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c already deleted. [ 1076.537582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.537829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.538272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.538476] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.687131] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.687463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.687587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.687933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.688262] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.688408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.688518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.688773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.688916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.689090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.689351] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.689521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.689622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.689852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.690121] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.690284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.690396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.690625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.691413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.691413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.691413] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.069398] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.069815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.069815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.069815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.070142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.070142] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c already deleted. [ 1077.070142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.193906] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 975f007e-412c-4399-9443-27166cb23d7c: rpc.has_security_group_logging(os_id): False [ 1077.212548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.212689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.212755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.212976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.213102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.213253] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.213347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.213405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.213553] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.213626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.213823] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.213928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.213998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.214159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.214234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.214414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.214516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.214562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.214693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.214765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.214850] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be created. [ 1077.274444] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.274659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.274702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.275051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.275302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.292661] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: IN_PROGRESS for 2s [ 1077.385442] env[65788]: INFO networking_nsxv3.common.synchronization [req-b4e908a1-a50d-494c-992f-fa86fa9c6da7 req-40903a8a-1610-4049-9fa1-3f11eeb4f9b6 tempest-ServerRescueTestJSON-116164819 tempest-ServerRescueTestJSON-116164819-project-member] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1077.387051] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGHEST for action security_group_members [ 1077.387763] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.387904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.387976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.388247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.388468] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.388585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.388649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.388820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.388908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.389021] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.894743] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.894743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.894743] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.895018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.906346] env[65788]: INFO networking_nsxv3.common.synchronization [req-b4c0cefa-be67-4d53-98e6-b30a8094ccdb req-62160d12-b986-40dd-85b8-4673f6415a0f tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1077.909243] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1077.909243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.909243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.909243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.909243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.909243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.909243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.909243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.909243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.909243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.909243] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.916825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.917082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.917195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.917258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.917448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.918476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.918476] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be updated. [ 1077.947621] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.947621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.947621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.947862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.947862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.959699] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: IN_PROGRESS for 2s [ 1078.316089] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.316482] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.316482] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.316855] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.317029] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.317310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.317310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.317454] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.317710] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.317832] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.317948] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.318074] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.318187] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.318298] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.318445] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.318592] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.337458] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.337620] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1078.337761] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.337937] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.338268] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.338443] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.338562] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.338882] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.339031] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dacd320-d0c4-4d3b-9ee2-8ae77db35fce',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.411442] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.411649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.411649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.411885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.412052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.412258] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.412487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.412487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.412574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.412649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.412733] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c already deleted. [ 1078.412838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.841709] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.842048] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.842255] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.842819] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.842819] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.843058] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 6dacd320-d0c4-4d3b-9ee2-8ae77db35fce not found, creating... [ 1078.843367] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.843610] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.843800] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.845028] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.845028] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.845028] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.845028] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.845246] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.845363] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.845545] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.845770] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 6dacd320-d0c4-4d3b-9ee2-8ae77db35fce is going to be created. [ 1078.866372] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.866594] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.866720] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.866994] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.867231] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.867462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.307353] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: SUCCESS [ 1079.307670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.570594] env[65788]: INFO networking_nsxv3.common.synchronization [req-b4c0cefa-be67-4d53-98e6-b30a8094ccdb req-3ed39494-a7ee-4d1a-bf58-918ea4dee425 service nova] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1079.570838] env[65788]: INFO networking_nsxv3.common.synchronization [req-b4c0cefa-be67-4d53-98e6-b30a8094ccdb req-3ed39494-a7ee-4d1a-bf58-918ea4dee425 service nova] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1079.570936] env[65788]: INFO networking_nsxv3.common.synchronization [req-b4c0cefa-be67-4d53-98e6-b30a8094ccdb req-3ed39494-a7ee-4d1a-bf58-918ea4dee425 service nova] Enqueued Resource ID: 6dacd320-d0c4-4d3b-9ee2-8ae77db35fce with Priority: HIGHEST for action port [ 1079.571417] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1079.571551] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1079.571648] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dacd320-d0c4-4d3b-9ee2-8ae77db35fce with Priority: HIGHEST for action port [ 1079.571956] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.572180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.572290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.572510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.572592] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.573594] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.573764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.573858] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.574186] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.574302] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.574423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.574504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.574672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.574781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.574894] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.575788] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.576444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.576444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.576444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.576444] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dacd320-d0c4-4d3b-9ee2-8ae77db35fce',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.968470] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 in Status: SUCCESS [ 1079.968648] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 deletion is rescheduled due to dependency. [ 1079.968759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.078624] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.078791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.078884] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.081722] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6dacd320-d0c4-4d3b-9ee2-8ae77db35fce with status ACTIVE [ 1080.081996] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.082226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.082226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.082443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.082592] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.082736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.083453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.083453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.083453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.083453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.083453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.083636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.083636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.083683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.083784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.083831] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6dacd320-d0c4-4d3b-9ee2-8ae77db35fce is going to be updated. [ 1080.106714] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.107202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.107202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.107371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.107458] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.107673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dacd320-d0c4-4d3b-9ee2-8ae77db35fce" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.581398] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.598287] env[65788]: INFO networking_nsxv3.common.synchronization [req-e3d610cd-4e19-446a-b682-0e745082195c req-cc789c4a-611a-4a3b-8ee6-7b2def986aa0 tempest-ServerAddressesTestJSON-1371429517 tempest-ServerAddressesTestJSON-1371429517-project-member] Enqueued Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_members [ 1080.598843] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGHEST for action security_group_members [ 1080.599430] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.599580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.599651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.599882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.601364] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.601537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.601639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.601877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.601995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.602143] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.085083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.085249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.085322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.085709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.085872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.085980] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c is going to be created. [ 1081.104101] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.104324] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.104425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.104626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.104708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.104984] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.105086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.105144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.105300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.105386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.105480] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ded108-574f-4c27-b008-f6c2b759b560 is going to be updated. [ 1081.114738] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.114979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.115148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.115399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.115570] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.125687] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: UNINITIALIZED for 2s [ 1081.147368] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.147593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.147716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.147987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.148189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.159714] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ded108-574f-4c27-b008-f6c2b759b560 in Status: IN_PROGRESS for 2s [ 1081.192946] env[65788]: INFO networking_nsxv3.common.synchronization [req-68164992-2b0f-4007-a141-e7eb204b035c req-0c000708-8aac-432f-beed-ca108990c3de tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 1081.194026] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGHEST for action security_group_members [ 1081.194026] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.194233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.194233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.194492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.198289] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.198443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.198516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.198727] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.198821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.198927] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.251069] env[65788]: INFO networking_nsxv3.common.synchronization [req-68164992-2b0f-4007-a141-e7eb204b035c req-0c000708-8aac-432f-beed-ca108990c3de tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: b3704f12-a32d-4311-b284-5412f0c5f8e6 with Priority: HIGHEST for action port [ 1081.251617] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3704f12-a32d-4311-b284-5412f0c5f8e6 with Priority: HIGHEST for action port [ 1081.251931] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3704f12-a32d-4311-b284-5412f0c5f8e6 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.252084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.252136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.252337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.252418] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3704f12-a32d-4311-b284-5412f0c5f8e6',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.703627] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.703927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.703927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.704191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.704293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.704521] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.704631] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.704694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.704881] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.705050] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.705175] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be updated. [ 1081.754794] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3704f12-a32d-4311-b284-5412f0c5f8e6 with status ACTIVE [ 1081.755067] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.755215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.755287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.755595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.755692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.755877] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.755978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.756055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.756226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.756338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.756505] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.756598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.756660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.756797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.756871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.756955] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3704f12-a32d-4311-b284-5412f0c5f8e6 is going to be updated. [ 1081.770231] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.770403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.770403] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.770597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.770734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.778437] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: IN_PROGRESS for 2s [ 1081.792072] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.792306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.792306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.792537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.792643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.792790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3704f12-a32d-4311-b284-5412f0c5f8e6" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.248873] env[65788]: INFO networking_nsxv3.common.synchronization [req-c9158611-e755-4be7-b9b5-1e8a56efdace req-539c293b-f6f7-4bd1-ac24-3b23830eb49a tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1082.249557] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1082.249880] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.250257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.250352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.250520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.250688] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.250794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.250857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.251660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.251787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.252386] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.565634] env[65788]: INFO networking_nsxv3.common.synchronization [req-cb294a2a-5ff0-4513-b060-5f423d57801a req-aee1234e-3fce-4b02-a0e1-1d9f6e1351c8 tempest-ListServerFiltersTestJSON-1726380347 tempest-ListServerFiltersTestJSON-1726380347-project-member] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1082.566198] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1082.566666] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.566774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.566774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.566990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.567210] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.567283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.567356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.567507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.567606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.567701] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.654636] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.654838] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.654974] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.655738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.655738] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.655934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.655934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.656149] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.656293] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.656506] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.656617] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.656733] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.656912] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.657080] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.657211] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.657347] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.679294] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.679463] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.679603] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.679779] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-936" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.680127] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.680308] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.680426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.680766] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.680903] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54bb98b-0279-4c1c-97d7-9ee36a0768ea',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.759524] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.759883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.759883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.759883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.782689] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.783066] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.783210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.783294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.783506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.783594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.783714] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1082.812295] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.812984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.812984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.812984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.812984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.826646] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1082.939372] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e851bc53-83d7-4e11-b344-677096b9df1e tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_rules [ 1082.939936] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_rules [ 1082.940568] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.940941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.941313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.941910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.942516] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.063694] env[65788]: INFO networking_nsxv3.common.synchronization [None req-edbff011-d4ec-478d-9e69-744783e2e78f tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_rules [ 1083.064314] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_rules [ 1083.064607] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.064781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.070712] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.149103] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: SUCCESS [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.149103] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.149103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.149103] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.170562] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ded108-574f-4c27-b008-f6c2b759b560 in Status: SUCCESS [ 1083.170799] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ded108-574f-4c27-b008-f6c2b759b560 deletion is rescheduled due to dependency. [ 1083.170845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.183394] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.183394] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.183394] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.183809] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.184047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.184324] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port f54bb98b-0279-4c1c-97d7-9ee36a0768ea not found, creating... [ 1083.184627] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.185133] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.185133] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.185305] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.185488] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.185822] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.186119] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.186227] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.186474] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.186667] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.186849] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: f54bb98b-0279-4c1c-97d7-9ee36a0768ea is going to be created. [ 1083.209824] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.210150] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.210366] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.210678] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.210916] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.211202] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.466952] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.467139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.467180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.467392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.467484] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.467578] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 already deleted. [ 1083.467664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.467813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.468506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.468506] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.573762] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.647319] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.789178] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 975f007e-412c-4399-9443-27166cb23d7c in Status: SUCCESS [ 1083.789456] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 975f007e-412c-4399-9443-27166cb23d7c deletion is rescheduled due to dependency. [ 1083.789486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.928121] env[65788]: INFO networking_nsxv3.common.synchronization [req-c9158611-e755-4be7-b9b5-1e8a56efdace req-fe7c6fdb-6bd4-4e61-9e6f-987f11b698ec service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 1083.928121] env[65788]: INFO networking_nsxv3.common.synchronization [req-c9158611-e755-4be7-b9b5-1e8a56efdace req-fe7c6fdb-6bd4-4e61-9e6f-987f11b698ec service nova] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1083.928121] env[65788]: INFO networking_nsxv3.common.synchronization [req-c9158611-e755-4be7-b9b5-1e8a56efdace req-fe7c6fdb-6bd4-4e61-9e6f-987f11b698ec service nova] Enqueued Resource ID: f54bb98b-0279-4c1c-97d7-9ee36a0768ea with Priority: HIGHEST for action port [ 1083.928121] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_rules [ 1083.928121] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1083.928121] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54bb98b-0279-4c1c-97d7-9ee36a0768ea with Priority: HIGHEST for action port [ 1083.928716] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.929025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.929191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.929784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.929952] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.932900] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.932900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.932900] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.932900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.932900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.932900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.932900] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54bb98b-0279-4c1c-97d7-9ee36a0768ea',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.104781] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.104781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.104781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.104781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.104781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.104781] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1084.127294] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.127294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.127489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.127677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.127677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.127740] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 already deleted. [ 1084.127785] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.136855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.136855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.136855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.137114] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.137248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.149678] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1084.153077] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c: rpc.has_security_group_logging(os_id): False [ 1084.170497] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.170497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.170497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.170652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.170720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.170959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.171101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.171144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.171279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.171352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.171434] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c is going to be created. [ 1084.250868] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.251046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.251115] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.251317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.252042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.264244] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: IN_PROGRESS for 2s [ 1084.435296] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.435608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.435731] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f54bb98b-0279-4c1c-97d7-9ee36a0768ea with status ACTIVE [ 1084.436198] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.436198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.436198] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.436391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.436494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.436679] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.436796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.437090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.437296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.437414] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.437634] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.437742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.437832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.437998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.438090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.438181] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f54bb98b-0279-4c1c-97d7-9ee36a0768ea is going to be updated. [ 1084.470153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.470354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.470395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.470610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.470745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.470914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f54bb98b-0279-4c1c-97d7-9ee36a0768ea" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.840909] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1084.841729] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 1084.843766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.843766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.843766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.843766] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.843766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.843766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.843766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.843766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.843766] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.346631] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.852264] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.162902] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1086.163489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.284384] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: SUCCESS [ 1086.284625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.354552] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.354728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.354781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.355024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.355125] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.355251] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1086.395654] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.395654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.395654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.395654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.395654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.407320] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1086.758936] env[65788]: INFO networking_nsxv3.common.synchronization [req-36bd93e2-1542-47ab-99f4-ede1cc96e07e req-2b92655c-ec71-4479-a5c9-90a10ac3f2d7 tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_members [ 1086.760196] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGHEST for action security_group_members [ 1086.760196] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.760196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.760196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.760379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.760555] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.763248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.763248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.763248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.763248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.763248] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.264404] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.264796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.264796] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.265019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.265187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.265504] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.265589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.265758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.266065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.266251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.266327] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 is going to be updated. [ 1087.299847] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.299847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.300199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.300199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.300461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.309252] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: IN_PROGRESS for 2s [ 1088.418482] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1088.418966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.418966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.419145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.419342] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.419462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.419593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.419772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.419889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.419963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.420272] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.680203] env[65788]: INFO networking_nsxv3.common.synchronization [req-e75ed959-1e13-4d21-8ca6-0c611725595a req-3518aa35-c6c9-437a-b69c-5f20c7314ba2 tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1088.680602] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1088.680910] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.681206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.681306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.681562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.681712] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.681815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.681880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.682064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.682154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.682253] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.922743] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.922898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.922969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.923221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.923392] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.923623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.923623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.923711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.923769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.923854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.924020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.924182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.924225] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.924371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.924687] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.924687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.924687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.924821] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.924850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.924967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.925016] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.990124] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.990324] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.990448] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.990767] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.991037] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.991217] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.991557] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.991557] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.991708] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.991866] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.991973] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.992091] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.992195] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.992300] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.992401] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.992525] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.013582] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.013881] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.013881] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.014031] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.014420] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.014598] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.014713] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.015042] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.015205] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.184894] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.185101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.185101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.185338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.185428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.185635] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.185765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.185800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.186026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.186103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.186189] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45f89b37-71e4-413c-a620-b4180609f205 already deleted. [ 1089.186271] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.323718] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 in Status: SUCCESS [ 1089.323718] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 deletion is rescheduled due to dependency. [ 1089.323718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.427842] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f8fa77-dfd6-4877-84c2-f9760d23fdfb: rpc.has_security_group_logging(os_id): False [ 1089.454318] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.454432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.454510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.454728] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.454820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.455054] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.455185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.455255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.455416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.455497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.455683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.455778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.455839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.455978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.456081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.456263] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.456352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.456402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.456558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.456655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.458086] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1089.518153] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.519270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.519270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.519508] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.519735] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.519840] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 not found, creating... [ 1089.520177] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.520330] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.520452] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.520710] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.520832] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.521194] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.521404] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.521503] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.521720] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.521856] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.522008] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 is going to be created. [ 1089.545233] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.545561] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.545647] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.545988] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.546233] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.546462] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.549123] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.549394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.549394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.549547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.549663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.607931] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1090.293466] env[65788]: INFO networking_nsxv3.common.synchronization [req-e75ed959-1e13-4d21-8ca6-0c611725595a req-c3399958-2a10-4f37-9e96-9d105b7f864b service nova] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1090.293466] env[65788]: INFO networking_nsxv3.common.synchronization [req-e75ed959-1e13-4d21-8ca6-0c611725595a req-c3399958-2a10-4f37-9e96-9d105b7f864b service nova] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1090.293648] env[65788]: INFO networking_nsxv3.common.synchronization [req-e75ed959-1e13-4d21-8ca6-0c611725595a req-c3399958-2a10-4f37-9e96-9d105b7f864b service nova] Enqueued Resource ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 with Priority: HIGHEST for action port [ 1090.293843] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1090.293968] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1090.294138] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 with Priority: HIGHEST for action port [ 1090.294785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.294885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.294885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.295157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.295215] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.296129] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.296233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.296233] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.296388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.296663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.296663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.296768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.296938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.296938] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.296998] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.298301] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.298301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.298383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.298539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.298595] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.800369] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.800956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.800956] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.801982] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 with status ACTIVE [ 1090.802238] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.802418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.802690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.802850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.803091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.803306] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.803609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.803609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.803815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.803945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.804320] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.804428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.804527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.804789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.804931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.806036] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 is going to be updated. [ 1090.841841] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.842022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.842022] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.842281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.842456] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.842628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.308440] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.623963] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1091.623963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.810786] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.811096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.811096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.811867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.811867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.811867] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45f89b37-71e4-413c-a620-b4180609f205 is going to be created. [ 1091.842409] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.842409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.842622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.842792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.843020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.854990] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: UNINITIALIZED for 2s [ 1093.475322] env[65788]: INFO networking_nsxv3.common.synchronization [req-c0dfa611-d853-4b3c-8e69-6a6e06812e1d req-6c3053fc-80ea-44ee-b366-726cb430ef9e tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1093.475567] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1093.475880] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.476079] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.476189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.476470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.476709] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.476864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.476964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.477207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.477343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.477512] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.840106] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.840313] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.840438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.840698] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.841239] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.841493] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.842594] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.842956] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.843134] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.843352] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.843467] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.843571] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.843676] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.843856] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.844085] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.844278] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.866057] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: SUCCESS [ 1093.866280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.866444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.866690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.867217] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.867359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.867427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.867597] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.867683] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.867776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.867868] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.870732] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.870895] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1093.871328] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.871328] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-961" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.871619] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.871809] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.872442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.872442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.872589] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.983309] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.001123] env[65788]: INFO networking_nsxv3.common.synchronization [req-ab84c88f-26db-4741-b0cb-85fc1b4ae69c req-b0b68ee7-2951-4b12-bab2-22d4a48be870 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1094.001631] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1094.001932] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.002306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.002449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.002691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.002891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.003535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.003535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.003535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.003535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.003535] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.370773] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.375218] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.375542] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.375691] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.376119] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.376339] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.376517] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 not found, creating... [ 1094.376834] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.377034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.377171] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.377492] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.377686] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.378056] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.378253] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.378371] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.378600] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.378731] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.378891] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 is going to be created. [ 1094.402018] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.402390] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.402605] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.403032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.403388] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.403737] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.489055] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.506197] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.506356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.506399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.506667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.554552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.554826] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.554949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.555028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.555244] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.555335] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.555429] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1094.601098] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.601295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.601341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.601543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.601684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.611524] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1094.874689] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45f89b37-71e4-413c-a620-b4180609f205: rpc.has_security_group_logging(os_id): False [ 1094.893010] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.893237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.893313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.893660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.893660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.894543] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.894543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.894543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.894543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.894543] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.894543] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45f89b37-71e4-413c-a620-b4180609f205 is going to be created. [ 1094.965719] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.965895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.965967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.966500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.966500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.978171] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: IN_PROGRESS for 2s [ 1094.992201] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.992201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.992201] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.992562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.992677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.992821] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1095.027013] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.027205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.027280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.027489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.027806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.056751] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1095.112398] env[65788]: INFO networking_nsxv3.common.synchronization [req-c0dfa611-d853-4b3c-8e69-6a6e06812e1d req-44a33a61-35f7-4a92-9a7e-796eca03bd4f service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 1095.112398] env[65788]: INFO networking_nsxv3.common.synchronization [req-c0dfa611-d853-4b3c-8e69-6a6e06812e1d req-44a33a61-35f7-4a92-9a7e-796eca03bd4f service nova] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1095.112398] env[65788]: INFO networking_nsxv3.common.synchronization [req-c0dfa611-d853-4b3c-8e69-6a6e06812e1d req-44a33a61-35f7-4a92-9a7e-796eca03bd4f service nova] Enqueued Resource ID: bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 with Priority: HIGHEST for action port [ 1095.112398] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_rules [ 1095.112398] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1095.112398] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 with Priority: HIGHEST for action port [ 1095.112398] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.112398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.112398] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.112945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.113388] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.115473] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.115710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.116044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.116284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.116425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.117067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.117244] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.622242] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.622242] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 with status ACTIVE [ 1095.622242] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.622242] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.622242] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.623068] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.623068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.623068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.623068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.623068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.623068] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7 is going to be updated. [ 1095.646809] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.647076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.647076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.647196] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.647325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.647526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf9cc23c-7ca8-42bb-bf67-77a5f6905ff7" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.622628] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1096.623963] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 1096.623963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.992977] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: SUCCESS [ 1096.993150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.067200] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1097.067493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.067690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.067984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.068243] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.068405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.068500] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.068704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.069559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.069559] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.571189] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.073619] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.578313] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.578468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.578538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.578807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.578927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.579066] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1098.610795] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.610972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.610972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.611209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.611437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.622158] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1100.113125] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1100.113432] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1100.425533] env[65788]: INFO networking_nsxv3.common.synchronization [req-717686a4-09f9-4626-8772-71ef9cc8cf9e req-96e1e097-79d1-4107-8d2e-5df03281950b tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_members [ 1100.426144] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_members [ 1100.426407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.426532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.426628] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.426932] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.427110] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.427221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.427280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.427442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.427530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.427624] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.634161] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 4s [ 1100.900107] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.900312] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.900438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.900704] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.900965] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.901136] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.901250] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.901475] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.901603] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.901828] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.901937] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.902057] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.902164] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.902293] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.902400] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.902536] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.923456] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.923456] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.923456] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.923456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.923456] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.923456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.923456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.923456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.923456] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c92167d3-22a7-4ec1-95ad-8ffe26f15d42',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.930043] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.930281] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.930358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.930641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.930906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.931096] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.931662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.931662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.931662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.931823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.931868] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c already deleted. [ 1100.931987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.271091] env[65788]: INFO networking_nsxv3.common.synchronization [None req-38cdc4ff-a4cb-4edf-b579-c51260eae3e8 None None] Enqueued Resource ID: 2c794f50-27ca-458b-b90c-7af1b205f97c with Priority: HIGHEST for action port [ 1101.271363] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c794f50-27ca-458b-b90c-7af1b205f97c with Priority: HIGHEST for action port [ 1101.271930] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c794f50-27ca-458b-b90c-7af1b205f97c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.272222] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c794f50-27ca-458b-b90c-7af1b205f97c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.272313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c794f50-27ca-458b-b90c-7af1b205f97c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.272568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c794f50-27ca-458b-b90c-7af1b205f97c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.272651] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c794f50-27ca-458b-b90c-7af1b205f97c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.429513] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.429513] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port c92167d3-22a7-4ec1-95ad-8ffe26f15d42 not found, creating... [ 1101.429513] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.429513] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.429925] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.429925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.429925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.429925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.429925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.430095] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: c92167d3-22a7-4ec1-95ad-8ffe26f15d42 is going to be created. [ 1101.453246] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.453246] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.453246] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.453859] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.455208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.455530] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.774818] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c794f50-27ca-458b-b90c-7af1b205f97c [ 1101.775064] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.775200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.775268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.775563] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.775660] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.775762] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c794f50-27ca-458b-b90c-7af1b205f97c already deleted. [ 1101.775840] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c794f50-27ca-458b-b90c-7af1b205f97c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.343106] env[65788]: INFO networking_nsxv3.common.synchronization [req-717686a4-09f9-4626-8772-71ef9cc8cf9e req-455f3dc9-6113-4dc6-ac94-4536edcbcf8d service nova] Enqueued Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_rules [ 1102.343361] env[65788]: INFO networking_nsxv3.common.synchronization [req-717686a4-09f9-4626-8772-71ef9cc8cf9e req-455f3dc9-6113-4dc6-ac94-4536edcbcf8d service nova] Enqueued Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_members [ 1102.343422] env[65788]: INFO networking_nsxv3.common.synchronization [req-717686a4-09f9-4626-8772-71ef9cc8cf9e req-455f3dc9-6113-4dc6-ac94-4536edcbcf8d service nova] Enqueued Resource ID: c92167d3-22a7-4ec1-95ad-8ffe26f15d42 with Priority: HIGHEST for action port [ 1102.343899] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_rules [ 1102.344040] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_members [ 1102.344140] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c92167d3-22a7-4ec1-95ad-8ffe26f15d42 with Priority: HIGHEST for action port [ 1102.344528] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.344610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.344651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.345552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.345552] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.345964] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.346098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.346169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.346360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.346525] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.349051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.349051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.349051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.349051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.349051] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.349051] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.349051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.349051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.349051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.349051] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c92167d3-22a7-4ec1-95ad-8ffe26f15d42',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.644138] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1102.644435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.644615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.644801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.644982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.645112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.645174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.645319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.645399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.645718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.645718] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.849919] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.852042] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.852254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.852447] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c92167d3-22a7-4ec1-95ad-8ffe26f15d42 with status ACTIVE [ 1102.852620] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.852731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.852794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.852984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.853085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.853256] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.853351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.853419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.853591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.853663] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.853838] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.853928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.853986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.854452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.854535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.854623] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c92167d3-22a7-4ec1-95ad-8ffe26f15d42 is going to be updated. [ 1102.878828] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.879594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.879594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.879594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.879594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.879594] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c92167d3-22a7-4ec1-95ad-8ffe26f15d42" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.148595] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.148862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.148985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.149293] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.149531] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.150428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.150578] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.151093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.151127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.151284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.151635] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.151720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.151866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.152062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.152274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.153230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.153413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.153602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.153777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.153997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.154145] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.356584] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.657036] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1: rpc.has_security_group_logging(os_id): False [ 1103.682784] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.682784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.682784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.682784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.702350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.703171] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.703171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.703171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.703171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.703171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.704016] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.704016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.704016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.704016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.704016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.704016] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.704216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.704216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.704269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.705019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.705019] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1103.786713] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.786865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.786933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.787154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.787298] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.805629] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1103.847416] env[65788]: INFO networking_nsxv3.common.synchronization [None req-052b7abf-ea4b-4636-92b1-703cfaa2cb6f None None] Enqueued Resource ID: 8d2c4631-dc89-4efd-a1d0-60f33053f262 with Priority: HIGHEST for action port [ 1103.847675] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d2c4631-dc89-4efd-a1d0-60f33053f262 with Priority: HIGHEST for action port [ 1103.848165] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d2c4631-dc89-4efd-a1d0-60f33053f262 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.848165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d2c4631-dc89-4efd-a1d0-60f33053f262" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.848165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d2c4631-dc89-4efd-a1d0-60f33053f262" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.848409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d2c4631-dc89-4efd-a1d0-60f33053f262" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.848491] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d2c4631-dc89-4efd-a1d0-60f33053f262',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.859183] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.859861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.859861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.859861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.859861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.859861] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c is going to be created. [ 1103.888584] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.888857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.888857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.889015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.889260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.899712] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c in Status: UNINITIALIZED for 2s [ 1104.354539] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d2c4631-dc89-4efd-a1d0-60f33053f262 [ 1104.354539] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.354539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.354539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.354539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.354539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.354539] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d2c4631-dc89-4efd-a1d0-60f33053f262 already deleted. [ 1104.354924] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d2c4631-dc89-4efd-a1d0-60f33053f262" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.819236] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1105.819532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.909632] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c in Status: SUCCESS [ 1105.909907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.910085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.910309] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.910508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.910623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.910684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.910832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.910969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.911012] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.911100] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.413856] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.788594] env[65788]: INFO networking_nsxv3.common.synchronization [req-9a9741c9-4844-4a9d-b1d1-a524d0811ed7 req-b2c67eae-6afa-456d-bbf4-d590d65c902e tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_members [ 1106.789354] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_members [ 1106.789764] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.789957] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.790068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.790400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.790598] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.790789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.790875] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.791099] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.791270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.791421] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.916071] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21d7211d-4d95-4d68-a449-61e8c3acb85c: rpc.has_security_group_logging(os_id): False [ 1106.939755] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.939944] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.940091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.940533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.940533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.940672] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.940776] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.940837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.941585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.941585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.941585] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c is going to be created. [ 1107.005263] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.005452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.005514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.005716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.005901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.018687] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c in Status: IN_PROGRESS for 2s [ 1107.173904] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.174131] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.174255] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.174573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.174845] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.175011] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.175129] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.175337] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.175529] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.175744] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.175853] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.175956] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.176070] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.176186] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.176275] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.176409] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.196757] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.196922] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.197073] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.197286] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.197579] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-b52fab48-ceab-4187-9cfa-b6a019c5f213 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.197749] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.197868] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.198209] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.198345] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b52fab48-ceab-4187-9cfa-b6a019c5f213',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.263151] env[65788]: INFO networking_nsxv3.common.synchronization [req-74580847-8854-4c88-92e8-cf28ebd52ab5 req-71baba70-3e5e-4aa2-890c-a52c94cb947e tempest-ListServerFiltersTestJSON-1726380347 tempest-ListServerFiltersTestJSON-1726380347-project-member] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1107.263677] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGHEST for action security_group_members [ 1107.263978] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.264116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.264188] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.264724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.264724] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.264724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.264724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.264954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.264954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.265069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.293315] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.293480] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.293540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.294349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.294349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.294349] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.294349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.294349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.294349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.294652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.294652] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 already deleted. [ 1107.295063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.701037] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.701037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.701223] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.701420] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.701572] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.701727] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port b52fab48-ceab-4187-9cfa-b6a019c5f213 not found, creating... [ 1107.701996] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.702168] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.702322] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.702600] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.702742] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.703041] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.703198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.703312] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.703514] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.703646] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.703804] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: b52fab48-ceab-4187-9cfa-b6a019c5f213 is going to be created. [ 1107.723658] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.723902] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.724126] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.724398] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.724701] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.724931] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.768117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.768247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.768284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.768481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.790143] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.790475] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.791086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.791086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.791086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.791229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.791256] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be updated. [ 1107.834680] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.834835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.834882] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.835131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.835248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.845105] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: IN_PROGRESS for 2s [ 1108.461355] env[65788]: INFO networking_nsxv3.common.synchronization [req-9a9741c9-4844-4a9d-b1d1-a524d0811ed7 req-47c0d888-388e-4b06-b75f-785601da8879 service nova] Enqueued Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_rules [ 1108.461355] env[65788]: INFO networking_nsxv3.common.synchronization [req-9a9741c9-4844-4a9d-b1d1-a524d0811ed7 req-47c0d888-388e-4b06-b75f-785601da8879 service nova] Enqueued Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_members [ 1108.461355] env[65788]: INFO networking_nsxv3.common.synchronization [req-9a9741c9-4844-4a9d-b1d1-a524d0811ed7 req-47c0d888-388e-4b06-b75f-785601da8879 service nova] Enqueued Resource ID: b52fab48-ceab-4187-9cfa-b6a019c5f213 with Priority: HIGHEST for action port [ 1108.461355] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_rules [ 1108.461355] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_members [ 1108.461809] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b52fab48-ceab-4187-9cfa-b6a019c5f213 with Priority: HIGHEST for action port [ 1108.462103] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.462561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.462561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.462561] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.462821] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.463962] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.463962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.463962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.464147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.464318] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.464510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.464870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.464870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.464870] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.465087] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.466206] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b52fab48-ceab-4187-9cfa-b6a019c5f213 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.466275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.466365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.466546] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.466653] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b52fab48-ceab-4187-9cfa-b6a019c5f213',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.969251] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.969251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.969251] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.970584] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b52fab48-ceab-4187-9cfa-b6a019c5f213 with status ACTIVE [ 1108.970863] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.971018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.971118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.972058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.972058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.972058] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.972058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.972058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.972058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.972058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.972693] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.973100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.973100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.973227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.973266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.974105] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b52fab48-ceab-4187-9cfa-b6a019c5f213 is going to be updated. [ 1108.997371] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.997619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.997742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.998074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.998338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.998619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b52fab48-ceab-4187-9cfa-b6a019c5f213" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.033196] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c in Status: SUCCESS [ 1109.033314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.112352] env[65788]: INFO networking_nsxv3.common.synchronization [None req-49bc1012-0fe1-4711-bae2-2e98e401d801 tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_rules [ 1109.113021] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_rules [ 1109.113386] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.113549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.113644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.113951] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.114143] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.215810] env[65788]: INFO networking_nsxv3.common.synchronization [None req-8f75185c-3e69-4aee-a626-f0c99cfbb6f0 tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_rules [ 1109.216398] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_rules [ 1109.216701] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.216807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.476623] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.578450] env[65788]: INFO networking_nsxv3.common.synchronization [req-017fea8b-e2e0-417a-974f-ff836dc55be7 req-0487ccb8-d47e-4d8d-b86e-52194bb05b6d tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1109.578946] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1109.579513] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.579642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.580792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.580792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.580792] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.580792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.580792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.580792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.580792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.580792] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.640189] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.640390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.640390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.640610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.640891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.641016] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 already deleted. [ 1109.641113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.641268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.641435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.641534] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.857335] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 in Status: SUCCESS [ 1109.857572] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 deletion is rescheduled due to dependency. [ 1109.857764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.979203] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.979629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.979629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.979758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.979758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.979915] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 is going to be created. [ 1110.005114] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.005262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.005424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.005580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.005801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.016093] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 in Status: UNINITIALIZED for 2s [ 1110.083625] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.162452] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.162656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.162763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.163060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.163194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.163329] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 already deleted. [ 1110.163450] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.586460] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.088784] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.088993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.089134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.089290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.089380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.089484] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1111.118686] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.118686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.118686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.118979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.118979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.128879] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1111.169701] env[65788]: INFO networking_nsxv3.common.synchronization [req-d32a0809-5017-4730-b19f-a5e29d965bcb req-e2cdeb5c-a3e0-4cbc-bd67-5eea299726e5 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1111.170254] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1111.170565] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.170694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.170792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.170998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.171274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.171378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.171442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.171615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.171712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.171809] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.518064] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.518064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.518064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.518064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.518064] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.518064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.518064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.518064] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.518848] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.519221] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.519478] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.519725] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.519952] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.520207] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.520438] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.520688] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.540600] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.540600] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.540789] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.541027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.541508] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-682c659e-bae2-4ade-908e-1f30e1d3f7ee taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.541753] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.541925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.542297] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.542598] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('682c659e-bae2-4ade-908e-1f30e1d3f7ee',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.675659] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.026844] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 in Status: SUCCESS [ 1112.026844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.026844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.026844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.026844] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.026844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.026844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.026844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.027191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.027191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.027191] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.046485] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.046702] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.046824] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.047097] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.047264] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.047432] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 682c659e-bae2-4ade-908e-1f30e1d3f7ee not found, creating... [ 1112.048415] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.049292] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.049480] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.049737] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.049875] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.050193] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.050352] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.050466] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.050783] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.050841] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.050941] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 682c659e-bae2-4ade-908e-1f30e1d3f7ee is going to be created. [ 1112.072191] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.072191] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.072329] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.073057] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.073057] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.073057] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.178254] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.529026] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.680455] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.680884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.680884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.680948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.681074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.681124] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c is going to be updated. [ 1112.721615] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.721829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.721829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.722092] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.722245] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.740704] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: IN_PROGRESS for 2s [ 1112.816592] env[65788]: INFO networking_nsxv3.common.synchronization [req-d32a0809-5017-4730-b19f-a5e29d965bcb req-a0f0cecd-da70-4a77-a403-45fa5db9672d service nova] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1112.816907] env[65788]: INFO networking_nsxv3.common.synchronization [req-d32a0809-5017-4730-b19f-a5e29d965bcb req-a0f0cecd-da70-4a77-a403-45fa5db9672d service nova] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1112.816907] env[65788]: INFO networking_nsxv3.common.synchronization [req-d32a0809-5017-4730-b19f-a5e29d965bcb req-a0f0cecd-da70-4a77-a403-45fa5db9672d service nova] Enqueued Resource ID: 682c659e-bae2-4ade-908e-1f30e1d3f7ee with Priority: HIGHEST for action port [ 1112.817480] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_rules [ 1112.817622] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1112.817761] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 682c659e-bae2-4ade-908e-1f30e1d3f7ee with Priority: HIGHEST for action port [ 1112.818085] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.818208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.818291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.818473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.818553] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.819435] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.819523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.819715] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-682c659e-bae2-4ade-908e-1f30e1d3f7ee taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.819836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.819880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.820055] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.820122] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('682c659e-bae2-4ade-908e-1f30e1d3f7ee',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.031892] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1dc5fb0-fcac-4a87-8333-bdbc08485f35: rpc.has_security_group_logging(os_id): False [ 1113.050730] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.051327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.051327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.051327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.051327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.051653] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.051769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.051832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.052042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.052124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.053090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 is going to be created. [ 1113.113953] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.115054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.115054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.115054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.115054] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.124333] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 in Status: IN_PROGRESS for 2s [ 1113.143907] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1113.144207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.321780] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.321913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.322036] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 682c659e-bae2-4ade-908e-1f30e1d3f7ee with status ACTIVE [ 1113.322163] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.322375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.322375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.322604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.322698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.322877] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.322997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.323063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.323180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.323254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.323431] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.323524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.323583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.323718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.323790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.323876] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 682c659e-bae2-4ade-908e-1f30e1d3f7ee is going to be updated. [ 1113.348204] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.348374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.348417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.348639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.348774] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.348934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-682c659e-bae2-4ade-908e-1f30e1d3f7ee" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.512490] env[65788]: INFO networking_nsxv3.common.synchronization [req-686e0a16-3485-496b-9118-e93895e39c9e req-da4fc429-4cf8-4297-99b0-f5bacc222d37 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1113.512648] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1113.512970] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.513101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.514038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.514038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.514038] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.514038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.514038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.514038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.514038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.514038] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.824544] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.824544] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.824922] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.824922] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.825171] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.825351] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.825517] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.825688] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.825834] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.826055] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.826167] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.826273] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.826377] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.826482] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.826585] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.826711] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.846716] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.846952] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1113.847116] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.847238] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-712" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.847678] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-792cd88d-484b-4547-b267-b821e9c47c16 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.847861] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.847978] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.848317] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.848457] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792cd88d-484b-4547-b267-b821e9c47c16',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.017397] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.017536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.017602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.017831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.017928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.018241] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.018241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.018431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.018431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.018519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.018595] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1114.046245] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.046401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.046445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.046646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.046792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.054818] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1114.352092] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.352345] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.352501] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.352807] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.352960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.353132] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 792cd88d-484b-4547-b267-b821e9c47c16 not found, creating... [ 1114.353398] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.353555] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.353672] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.353885] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.354037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.354312] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.354583] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.356047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.356047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.356047] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.356047] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 792cd88d-484b-4547-b267-b821e9c47c16 is going to be created. [ 1114.376217] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.376420] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.376548] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.376825] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.377071] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.377299] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.751179] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: SUCCESS [ 1114.751407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.751576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.752132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.752132] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.752238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.752238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.752369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.752449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.752544] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.118403] env[65788]: INFO networking_nsxv3.common.synchronization [req-686e0a16-3485-496b-9118-e93895e39c9e req-0d4377c6-29fb-4c94-9728-8215f11329b8 service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 1115.122036] env[65788]: INFO networking_nsxv3.common.synchronization [req-686e0a16-3485-496b-9118-e93895e39c9e req-0d4377c6-29fb-4c94-9728-8215f11329b8 service nova] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1115.122036] env[65788]: INFO networking_nsxv3.common.synchronization [req-686e0a16-3485-496b-9118-e93895e39c9e req-0d4377c6-29fb-4c94-9728-8215f11329b8 service nova] Enqueued Resource ID: 792cd88d-484b-4547-b267-b821e9c47c16 with Priority: HIGHEST for action port [ 1115.122036] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_rules [ 1115.122036] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1115.122036] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792cd88d-484b-4547-b267-b821e9c47c16 with Priority: HIGHEST for action port [ 1115.122036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.122413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.122413] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.122468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.122522] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.123463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.123602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.123738] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-792cd88d-484b-4547-b267-b821e9c47c16 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.124078] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.124078] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.124232] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.124381] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792cd88d-484b-4547-b267-b821e9c47c16',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.139110] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 in Status: SUCCESS [ 1115.139370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.254957] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.626112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.626263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.627646] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 792cd88d-484b-4547-b267-b821e9c47c16 with status ACTIVE [ 1115.627848] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.627982] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.628072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.628267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.628351] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.628529] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.628632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.628685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.628828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.628902] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.629098] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.629182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.629241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.629424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.629552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.629687] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 792cd88d-484b-4547-b267-b821e9c47c16 is going to be updated. [ 1115.652850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.653009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.653086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.653295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.653678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.653678] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-792cd88d-484b-4547-b267-b821e9c47c16" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.757235] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.064245] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1116.064416] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 1116.064586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.064756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.064991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.065189] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.065305] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.065369] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.065514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.065622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.065726] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.262034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.262034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.262034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.262034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.262034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.262034] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c is going to be updated. [ 1116.323751] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.323907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.323976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.324239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.324349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.334752] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: IN_PROGRESS for 2s [ 1116.568148] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.070336] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.573345] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.573742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.573742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.573872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.573966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.574094] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1117.608643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.608860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.608860] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.609096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.609243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.618979] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1118.345490] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: SUCCESS [ 1118.345748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.345940] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.346243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.346427] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.346580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.346650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.346831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.346917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.347074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.347193] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.850545] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.353374] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c: rpc.has_security_group_logging(os_id): False [ 1119.372216] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.372322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.372363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.372618] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.372746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.373219] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.373219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.373219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.373404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.373404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.373567] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c is going to be updated. [ 1119.453736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.454034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.454034] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.454180] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.454329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.471365] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: IN_PROGRESS for 2s [ 1119.632200] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1119.632424] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.632652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.632941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.633223] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.633396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.633494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.633893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.633893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.633962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.634105] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.122865] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1120.123193] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1120.136768] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.136984] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.137049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.137291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.137483] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.137591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.137701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.137895] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.138014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.138107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.138263] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.138358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.138419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.138562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.138704] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.138797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.138857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.138995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.139085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.139167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.139259] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.641737] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605d7441-fa35-48f3-be10-861643ff1c6c: rpc.has_security_group_logging(os_id): False [ 1120.659578] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.659838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.659939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.660182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.660307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.660567] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.660712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.660797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.661183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.661395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.661629] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.661765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.661853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.662062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.662161] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.662352] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.662449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.662512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.662654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.662733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.662858] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1120.725463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.725607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.725711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.725893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.726046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.739185] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1121.461327] env[65788]: INFO networking_nsxv3.common.synchronization [req-c13f3a5c-aca2-4169-8690-bf916b7b86cb req-210a25d4-2abc-4d55-9694-3d2ce82558b0 tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1121.461950] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1121.462295] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.462608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.462681] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.462885] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.463129] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.463239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.463313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.463460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.463586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.463658] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.485937] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: SUCCESS [ 1121.486397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.849109] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.849403] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.849570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.849851] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.852342] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.852552] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.852863] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.853149] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.853306] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.853530] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.853641] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.853759] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.853857] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.853964] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.854081] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.854217] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.879643] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.879834] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1121.879958] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.880186] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-238" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.880522] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-fe522376-5e10-4ea3-84a4-e64e811c3c49 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.880696] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.880816] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.881305] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.881415] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe522376-5e10-4ea3-84a4-e64e811c3c49',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.966641] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.023913] env[65788]: INFO networking_nsxv3.common.synchronization [None req-6171557f-ad1c-4c41-805d-5e843e55db86 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1122.024120] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1122.024419] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.024542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.024629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.025291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.025813] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.025931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.025999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.026189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.026276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.026371] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.389204] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.389204] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.389204] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.390282] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.390444] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.390607] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port fe522376-5e10-4ea3-84a4-e64e811c3c49 not found, creating... [ 1122.390887] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.391084] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.391516] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.391516] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.391610] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.393493] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.393493] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.393493] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.393493] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.393689] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.393740] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: fe522376-5e10-4ea3-84a4-e64e811c3c49 is going to be created. [ 1122.416427] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.416534] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.416569] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.416852] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.417142] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.417376] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.468894] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.529454] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.529737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.529845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.530091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.530218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.530516] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.530664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.530759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.531040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.531157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.531289] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be deleted. [ 1122.567422] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.567579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.567651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.567884] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.567970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.568083] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.757032] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1122.757270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.970863] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.970986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.971082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.971276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.971370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.971471] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf is going to be updated. [ 1123.004730] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.005036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.005095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.005329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.005587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.027345] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: IN_PROGRESS for 2s [ 1123.118678] env[65788]: INFO networking_nsxv3.common.synchronization [req-c13f3a5c-aca2-4169-8690-bf916b7b86cb req-dfa8451f-34db-4de2-869a-d894b56b3767 service nova] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 1123.118858] env[65788]: INFO networking_nsxv3.common.synchronization [req-c13f3a5c-aca2-4169-8690-bf916b7b86cb req-dfa8451f-34db-4de2-869a-d894b56b3767 service nova] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1123.119008] env[65788]: INFO networking_nsxv3.common.synchronization [req-c13f3a5c-aca2-4169-8690-bf916b7b86cb req-dfa8451f-34db-4de2-869a-d894b56b3767 service nova] Enqueued Resource ID: fe522376-5e10-4ea3-84a4-e64e811c3c49 with Priority: HIGHEST for action port [ 1123.119551] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_rules [ 1123.119688] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1123.119788] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe522376-5e10-4ea3-84a4-e64e811c3c49 with Priority: HIGHEST for action port [ 1123.120275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.120429] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.120511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.120691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.120774] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.121662] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.121759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.121960] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe522376-5e10-4ea3-84a4-e64e811c3c49 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.122075] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.122131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.122313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.122375] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe522376-5e10-4ea3-84a4-e64e811c3c49',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.625735] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.625735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.626655] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe522376-5e10-4ea3-84a4-e64e811c3c49 with status ACTIVE [ 1123.626655] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.626815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.626815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.627341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.627436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.627642] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.627746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.627810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.628224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.628354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.628498] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.628593] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.628789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.629251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.629388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.629519] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe522376-5e10-4ea3-84a4-e64e811c3c49 is going to be updated. [ 1123.653251] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.653391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.654128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.654128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.654128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.654128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe522376-5e10-4ea3-84a4-e64e811c3c49" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.958047] env[65788]: INFO networking_nsxv3.common.synchronization [req-acc142e0-4d15-4bb0-8ddc-a2b5f79e0d30 req-cb3200bc-4517-4aae-a69a-1efd00fd8f6e tempest-ServerTagsTestJSON-641731625 tempest-ServerTagsTestJSON-641731625-project-member] Enqueued Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_members [ 1123.958669] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_members [ 1123.958972] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-baef0a74-ebad-4e33-b0aa-9bf55691a772 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.959122] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.959189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.959465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.959619] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.959739] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.959810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.959966] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.960063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.960156] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.375282] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.375413] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-848" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.375595] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-848" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.376038] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-848" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.377270] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.377270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.377483] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.379192] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.379192] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.379192] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.379192] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.379192] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.379192] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.379192] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.379192] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.379192] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.399166] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.399336] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1124.399387] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.399827] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-848" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.399976] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-74d2dd05-7bfd-4ab6-968e-c2698832be57 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.400172] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.400303] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.400628] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.400770] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74d2dd05-7bfd-4ab6-968e-c2698832be57',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.467465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.467465] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.467465] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 already deleted. [ 1124.467465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.904669] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.905573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.905573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.905573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.905573] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.905779] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 74d2dd05-7bfd-4ab6-968e-c2698832be57 not found, creating... [ 1124.906020] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.906141] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.906707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.906707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.906707] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.906851] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.907134] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.907341] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.908241] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.908241] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.908241] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 74d2dd05-7bfd-4ab6-968e-c2698832be57 is going to be created. [ 1124.931895] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.931895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.931895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.931895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.931895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.931895] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.041483] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: SUCCESS [ 1125.041483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.041483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.041483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.041483] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.041483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.041483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.041483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.041483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.041483] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.543601] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.677124] env[65788]: INFO networking_nsxv3.common.synchronization [req-acc142e0-4d15-4bb0-8ddc-a2b5f79e0d30 req-85eb85f2-996a-4197-addf-78d178a37088 service nova] Enqueued Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_rules [ 1125.677347] env[65788]: INFO networking_nsxv3.common.synchronization [req-acc142e0-4d15-4bb0-8ddc-a2b5f79e0d30 req-85eb85f2-996a-4197-addf-78d178a37088 service nova] Enqueued Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_members [ 1125.677487] env[65788]: INFO networking_nsxv3.common.synchronization [req-acc142e0-4d15-4bb0-8ddc-a2b5f79e0d30 req-85eb85f2-996a-4197-addf-78d178a37088 service nova] Enqueued Resource ID: 74d2dd05-7bfd-4ab6-968e-c2698832be57 with Priority: HIGHEST for action port [ 1125.678444] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_rules [ 1125.678641] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_members [ 1125.678698] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d2dd05-7bfd-4ab6-968e-c2698832be57 with Priority: HIGHEST for action port [ 1125.679109] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baef0a74-ebad-4e33-b0aa-9bf55691a772 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.679376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.679453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.679719] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.679809] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.681269] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-baef0a74-ebad-4e33-b0aa-9bf55691a772 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.681548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.681585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.681789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.681953] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.682065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.682130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.682284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.682407] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.682545] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.683509] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-74d2dd05-7bfd-4ab6-968e-c2698832be57 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.683661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.683701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.683831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.683908] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74d2dd05-7bfd-4ab6-968e-c2698832be57',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.046848] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.181790] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-baef0a74-ebad-4e33-b0aa-9bf55691a772 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.182532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.186552] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.187920] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74d2dd05-7bfd-4ab6-968e-c2698832be57 with status ACTIVE [ 1126.188212] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.188400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.188509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.188794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.188983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.189269] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.189443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.189564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.189762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.189935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.190249] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.190412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.190510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.190735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.190987] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.190987] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74d2dd05-7bfd-4ab6-968e-c2698832be57 is going to be updated. [ 1126.215035] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.215205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.215205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.215395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.215530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.215709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74d2dd05-7bfd-4ab6-968e-c2698832be57" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.551031] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.551152] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.551286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.551586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.551705] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.551836] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf is going to be updated. [ 1126.583234] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.583365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.584725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.584725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.584725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.593116] env[65788]: INFO networking_nsxv3.common.synchronization [req-4a6c7239-f0f4-4012-855f-d85f9d77695c req-ff8033ff-7f94-402c-bcb1-2329ced48f76 tempest-ServersTestJSON-1193364784 tempest-ServersTestJSON-1193364784-project-member] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1126.594223] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: IN_PROGRESS for 2s [ 1126.594719] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGHEST for action security_group_members [ 1126.595084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.595215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.595287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.595478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.595652] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.595787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.595856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.596016] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.596113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.596207] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.693422] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.099202] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.099596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.099596] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.099831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.099890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.100093] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.100199] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.100262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.100416] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.100541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.100584] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be updated. [ 1127.134577] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.135052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.135052] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.135371] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.137636] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.148658] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: IN_PROGRESS for 2s [ 1127.196479] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.196671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.196711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.197104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.197243] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.197380] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 is going to be created. [ 1127.225459] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.225459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.225459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.225672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.225672] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.236832] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 in Status: UNINITIALIZED for 2s [ 1128.031367] env[65788]: INFO networking_nsxv3.common.synchronization [req-b2281a4a-bb3f-4bce-84a0-9bef87035d72 req-bae14d9f-93b0-45f6-bcf3-bed235ebcbd7 tempest-ServerDiskConfigTestJSON-945811182 tempest-ServerDiskConfigTestJSON-945811182-project-member] Enqueued Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1128.031776] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605d7441-fa35-48f3-be10-861643ff1c6c with Priority: HIGHEST for action security_group_members [ 1128.032082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-605d7441-fa35-48f3-be10-861643ff1c6c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.032206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.032275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.032465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.032619] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.033330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.033330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.033430] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.033464] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.033560] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605d7441-fa35-48f3-be10-861643ff1c6c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.536156] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.536789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.536789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.536789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.536789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.536964] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.536964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.537091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.537191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.537272] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.537365] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c is going to be updated. [ 1128.566936] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.566936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.566936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.567295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.567295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.577117] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: IN_PROGRESS for 2s [ 1128.603907] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: SUCCESS [ 1128.604227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.604420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.604670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.605030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.605133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.605211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.605408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.605517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.605635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.605778] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.634303] env[65788]: INFO networking_nsxv3.common.synchronization [req-97baefcd-f52b-4314-9a15-888efc344fe4 req-14c5f6db-1735-4fde-be9a-f5e187df5b17 tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_members [ 1128.635726] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_members [ 1128.635726] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.635726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.635726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.635726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.635726] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.636067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.636067] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.636177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.636177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.636265] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.003792] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.003792] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.003792] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.008037] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.008494] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.008688] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.008810] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.009387] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.009604] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.009869] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.010031] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.010111] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.010218] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.010353] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.010483] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.010624] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.031785] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.032810] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1129.032810] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.032810] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-546" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.032810] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-c4045056-e39f-456d-9a9b-ccc392901801 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.033056] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.033056] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.033530] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.033720] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4045056-e39f-456d-9a9b-ccc392901801',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.109949] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.138943] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.139172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.139172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.139344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.139415] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.139556] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.139662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.139724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.139861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.139934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.140034] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 already deleted. [ 1129.140113] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.163344] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 in Status: SUCCESS [ 1129.163504] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 deletion is rescheduled due to dependency. [ 1129.164207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.246982] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 in Status: SUCCESS [ 1129.247349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.247529] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.247751] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.248062] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.248192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.248259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.248419] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.248504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.248591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.248681] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.535937] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.536204] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.536434] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.536594] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.536743] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.536898] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port c4045056-e39f-456d-9a9b-ccc392901801 not found, creating... [ 1129.537209] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.537367] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.537482] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.537698] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.537832] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.538124] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.538276] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.538384] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.538583] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.538712] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.538852] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: c4045056-e39f-456d-9a9b-ccc392901801 is going to be created. [ 1129.559118] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.559350] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.559478] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.559743] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.559975] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.560217] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.613018] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf: rpc.has_security_group_logging(os_id): False [ 1129.632107] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.632345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.632412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.633057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.652548] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.652838] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.652970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.653051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.653259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.653340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.653434] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf is going to be updated. [ 1129.750934] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-baef0a74-ebad-4e33-b0aa-9bf55691a772 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.752178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.752178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.752178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.752178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.752178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.752178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.752178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.752178] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.752452] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.752452] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-baef0a74-ebad-4e33-b0aa-9bf55691a772 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.752527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.752559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.752738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.752877] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.752970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.753047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.753221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.753346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.753395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.753471] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.774937] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.775151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.775151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.775361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.775501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.792780] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: IN_PROGRESS for 2s [ 1130.255679] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for baef0a74-ebad-4e33-b0aa-9bf55691a772: rpc.has_security_group_logging(os_id): False [ 1130.276850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.277359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.277491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.277725] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.277807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.278020] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.278128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.278194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.278356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.278432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.278632] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.278738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.278801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.278942] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.279584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.279974] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.280195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.280325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.280653] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.280775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.280896] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 is going to be created. [ 1130.286316] env[65788]: INFO networking_nsxv3.common.synchronization [req-97baefcd-f52b-4314-9a15-888efc344fe4 req-d9f9e846-8586-42f4-865c-d78e1c015892 service nova] Enqueued Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_rules [ 1130.286488] env[65788]: INFO networking_nsxv3.common.synchronization [req-97baefcd-f52b-4314-9a15-888efc344fe4 req-d9f9e846-8586-42f4-865c-d78e1c015892 service nova] Enqueued Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_members [ 1130.286686] env[65788]: INFO networking_nsxv3.common.synchronization [req-97baefcd-f52b-4314-9a15-888efc344fe4 req-d9f9e846-8586-42f4-865c-d78e1c015892 service nova] Enqueued Resource ID: c4045056-e39f-456d-9a9b-ccc392901801 with Priority: HIGHEST for action port [ 1130.287305] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_rules [ 1130.288074] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_members [ 1130.288206] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4045056-e39f-456d-9a9b-ccc392901801 with Priority: HIGHEST for action port [ 1130.288500] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.288626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.288696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.288886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.288970] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.290100] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.290228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.290317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.290499] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.290646] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.290746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.290794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.290931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.291212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.291212] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.293012] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4045056-e39f-456d-9a9b-ccc392901801 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.293236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.293313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.293474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.293552] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4045056-e39f-456d-9a9b-ccc392901801',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.351050] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.351226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.351264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.351460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.351640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.374569] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 in Status: IN_PROGRESS for 2s [ 1130.589380] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605d7441-fa35-48f3-be10-861643ff1c6c in Status: SUCCESS [ 1130.589380] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605d7441-fa35-48f3-be10-861643ff1c6c deletion is rescheduled due to dependency. [ 1130.589380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605d7441-fa35-48f3-be10-861643ff1c6c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.793446] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.795075] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4045056-e39f-456d-9a9b-ccc392901801 with status ACTIVE [ 1130.795390] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.795521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.795619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.795916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.796061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.796712] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.796712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.796712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.796956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.796956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.797421] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.797673] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.797801] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.798021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.798139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.798265] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4045056-e39f-456d-9a9b-ccc392901801 is going to be updated. [ 1130.800320] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.800320] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.821891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.822147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.822147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.822344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.822476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.822641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4045056-e39f-456d-9a9b-ccc392901801" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.285879] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.286129] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.286183] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.286457] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.286770] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.286935] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.287426] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.287751] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.287981] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.288430] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.288645] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.288778] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.288940] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.289123] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.289293] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.289489] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.296136] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.310911] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.311106] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1131.311840] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.311840] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.311840] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-57eef4ef-59f7-4dbd-8acb-a3a54928f031 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.312108] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.312108] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.312438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.312613] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57eef4ef-59f7-4dbd-8acb-a3a54928f031',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.798716] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.799070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.799070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.799266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.799357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.799464] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 is going to be created. [ 1131.806642] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: SUCCESS [ 1131.806865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.816014] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.816301] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.816382] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.816644] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.816788] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.816944] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 57eef4ef-59f7-4dbd-8acb-a3a54928f031 not found, creating... [ 1131.817282] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.817440] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.818263] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.818552] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.818711] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.819038] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.819208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.819327] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.819551] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.819689] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.819839] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 is going to be created. [ 1131.822528] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.822759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.822850] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.822960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.823134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.835372] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e84459-f201-4bd5-a48a-e23c87203964 in Status: UNINITIALIZED for 2s [ 1131.840736] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.840923] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.841058] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.841360] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.841598] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.841823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.389246] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 in Status: SUCCESS [ 1132.389507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.566042] env[65788]: INFO networking_nsxv3.common.synchronization [req-dc399533-0726-48ab-9c40-ae2e456caddb req-b5933285-3bdc-4740-9f7c-274e61d0f3fd service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1132.566042] env[65788]: INFO networking_nsxv3.common.synchronization [req-dc399533-0726-48ab-9c40-ae2e456caddb req-b5933285-3bdc-4740-9f7c-274e61d0f3fd service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1132.566042] env[65788]: INFO networking_nsxv3.common.synchronization [req-dc399533-0726-48ab-9c40-ae2e456caddb req-b5933285-3bdc-4740-9f7c-274e61d0f3fd service nova] Enqueued Resource ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 with Priority: HIGHEST for action port [ 1132.566042] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1132.566042] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1132.566042] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 with Priority: HIGHEST for action port [ 1132.566312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.566312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.566312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.566507] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.566550] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.569111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.569111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.569111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.569111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.569111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.569111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.569111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.569111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.569111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.569111] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.569437] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-57eef4ef-59f7-4dbd-8acb-a3a54928f031 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.569437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.569437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.569677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.569745] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57eef4ef-59f7-4dbd-8acb-a3a54928f031',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.074414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.074997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.074997] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.075915] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57eef4ef-59f7-4dbd-8acb-a3a54928f031 with status ACTIVE [ 1133.076153] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.076292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.076362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.076574] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.076812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.076880] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.077508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.077508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.077508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.077508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.077670] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.077670] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.077746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.077868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.077936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.078311] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 is going to be updated. [ 1133.103660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.103827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.103827] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.103996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.104120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.104294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.581043] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.852827] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e84459-f201-4bd5-a48a-e23c87203964 in Status: SUCCESS [ 1133.853090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.853491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.853718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.853980] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.854119] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.854185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.854363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.854463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.854568] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.854600] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.083959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.084344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.084344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.084425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.084514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.084618] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be created. [ 1134.110041] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.110202] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.110274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.110485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.110666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.124459] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: UNINITIALIZED for 2s [ 1134.356849] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.861113] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1e84459-f201-4bd5-a48a-e23c87203964: rpc.has_security_group_logging(os_id): False [ 1134.880024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.880024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.880024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.880024] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 is going to be created. [ 1134.944952] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.945221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.945221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.945422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.945615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.956514] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1e84459-f201-4bd5-a48a-e23c87203964 in Status: IN_PROGRESS for 2s [ 1135.672168] env[65788]: INFO networking_nsxv3.common.synchronization [req-4999e8a9-0673-4bcf-9dd6-727fcfe412dc req-24cf5004-51d7-4ef3-8154-78d63de10cff tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1135.672168] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1135.672168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.672168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.672168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.672168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.672168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.672168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.672168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.672168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.672168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.673083] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.138922] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1136.139098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.139886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.140501] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.141092] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.141230] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.141312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.141604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.142160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.142477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.142477] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.176494] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.176494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.176842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.176842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.177058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.177892] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.178174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.178174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.179124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.179329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.179455] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1136.220296] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.220538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.220538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.220787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.220996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.235159] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1136.647321] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.647504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.647576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.648354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.648354] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.648354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.648354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.648738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.648738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.648738] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.648738] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.648879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.648958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.649053] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.649659] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.649659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.649659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.649659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.649659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.649659] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.649917] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.926899] env[65788]: INFO networking_nsxv3.common.synchronization [None req-b18654a7-b25b-4af1-a2d3-cc6b433eb5f6 None None] Enqueued Resource ID: 331ce454-1104-4a70-b9f6-fb407b9ba33e with Priority: HIGHEST for action port [ 1136.927467] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331ce454-1104-4a70-b9f6-fb407b9ba33e with Priority: HIGHEST for action port [ 1136.927876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-331ce454-1104-4a70-b9f6-fb407b9ba33e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.927973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-331ce454-1104-4a70-b9f6-fb407b9ba33e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.927973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-331ce454-1104-4a70-b9f6-fb407b9ba33e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.928254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-331ce454-1104-4a70-b9f6-fb407b9ba33e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.928327] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('331ce454-1104-4a70-b9f6-fb407b9ba33e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.971355] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1e84459-f201-4bd5-a48a-e23c87203964 in Status: SUCCESS [ 1136.971950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.152251] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5: rpc.has_security_group_logging(os_id): False [ 1137.172285] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.172435] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.172503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.172761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.172857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.173034] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.173126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.173182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.173477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.173477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.173612] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.173711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.173768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.173911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.173981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.174188] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.174278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.174329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.174534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.174589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.174623] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be created. [ 1137.242069] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.242236] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.242312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.242531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.242731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.255462] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1137.431447] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 331ce454-1104-4a70-b9f6-fb407b9ba33e [ 1137.432082] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.432471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.432606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.433312] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.433460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.433589] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:331ce454-1104-4a70-b9f6-fb407b9ba33e already deleted. [ 1137.433704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-331ce454-1104-4a70-b9f6-fb407b9ba33e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.246030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1138.246360] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec deletion is rescheduled due to dependency. [ 1138.246360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.593164] env[65788]: INFO networking_nsxv3.common.synchronization [None req-6ee541c0-0547-4a53-9fd8-d6d8a23d95b6 None None] Enqueued Resource ID: ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0 with Priority: HIGHEST for action port [ 1138.593164] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0 with Priority: HIGHEST for action port [ 1138.593164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.593164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.593164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.595572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.595572] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.096478] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0 [ 1139.097048] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.097048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.097048] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.097630] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.097791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.097840] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0 already deleted. [ 1139.097910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecac6850-bb9c-4b6a-8ac1-ea71a03d99d0" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.269864] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1139.270805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.668487] env[65788]: INFO networking_nsxv3.common.synchronization [None req-37ba43cf-137e-4c80-9b41-fd7873f86643 None None] Enqueued Resource ID: 21ab1605-98f0-48d2-80e1-9a9c2c5b09fc with Priority: HIGHEST for action port [ 1139.668780] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ab1605-98f0-48d2-80e1-9a9c2c5b09fc with Priority: HIGHEST for action port [ 1139.669798] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-21ab1605-98f0-48d2-80e1-9a9c2c5b09fc taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.669798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21ab1605-98f0-48d2-80e1-9a9c2c5b09fc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.669798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21ab1605-98f0-48d2-80e1-9a9c2c5b09fc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.669798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21ab1605-98f0-48d2-80e1-9a9c2c5b09fc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.670060] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ab1605-98f0-48d2-80e1-9a9c2c5b09fc',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.174039] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21ab1605-98f0-48d2-80e1-9a9c2c5b09fc [ 1140.174039] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.174039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.174039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.174039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.174039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.174039] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21ab1605-98f0-48d2-80e1-9a9c2c5b09fc already deleted. [ 1140.174039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21ab1605-98f0-48d2-80e1-9a9c2c5b09fc" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.048938] env[65788]: INFO networking_nsxv3.common.synchronization [None req-2f4c8476-c9a9-469c-83c6-5bef0f1a43cd None None] Enqueued Resource ID: 0d9536ca-e713-49aa-a01f-4a68150cca41 with Priority: HIGHEST for action port [ 1141.049479] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d9536ca-e713-49aa-a01f-4a68150cca41 with Priority: HIGHEST for action port [ 1141.050151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d9536ca-e713-49aa-a01f-4a68150cca41 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.050276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d9536ca-e713-49aa-a01f-4a68150cca41" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.050340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d9536ca-e713-49aa-a01f-4a68150cca41" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.050587] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d9536ca-e713-49aa-a01f-4a68150cca41" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.050668] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d9536ca-e713-49aa-a01f-4a68150cca41',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.555420] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d9536ca-e713-49aa-a01f-4a68150cca41 [ 1141.555700] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.555908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.556014] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.556315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.556400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.556505] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d9536ca-e713-49aa-a01f-4a68150cca41 already deleted. [ 1141.556585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d9536ca-e713-49aa-a01f-4a68150cca41" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.262440] env[65788]: INFO networking_nsxv3.common.synchronization [req-c5ce7f51-dbe9-49fc-a38a-d6c5c3249be7 req-1f94d096-1ab2-4f06-af74-ca729c9ac88f tempest-DeleteServersTestJSON-549383550 tempest-DeleteServersTestJSON-549383550-project-member] Enqueued Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1144.264168] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb with Priority: HIGHEST for action security_group_members [ 1144.264168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.264168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.264168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.264168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.264168] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.264168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.264168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.264168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.264168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.264722] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f8fa77-dfd6-4877-84c2-f9760d23fdfb',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.767284] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.767537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.767657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.767990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.768165] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.768474] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.768638] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.768756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.769025] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.769224] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.769330] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb is going to be updated. [ 1144.803971] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.804219] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.804329] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.804586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.804784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.815685] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: IN_PROGRESS for 2s [ 1145.036681] env[65788]: INFO networking_nsxv3.common.synchronization [req-e651db62-8c9d-4590-90f4-1201e08231e2 req-ec2410be-63c6-4003-84f0-fd369bcc62bf tempest-ServerTagsTestJSON-641731625 tempest-ServerTagsTestJSON-641731625-project-member] Enqueued Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_members [ 1145.037333] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 with Priority: HIGHEST for action security_group_members [ 1145.037713] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-baef0a74-ebad-4e33-b0aa-9bf55691a772 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.037825] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.037900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.038157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.038334] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.038465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.038534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.038717] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.038838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.038964] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baef0a74-ebad-4e33-b0aa-9bf55691a772',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.541473] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.541815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.541815] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.541913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.542015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.542313] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.542410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.542410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.542612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.542730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.542730] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 is going to be updated. [ 1145.575014] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.575192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.575256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.575468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.575622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.584504] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 in Status: IN_PROGRESS for 2s [ 1145.756152] env[65788]: INFO networking_nsxv3.common.synchronization [req-1ce67f05-9f7f-4ee3-9952-40ca3561ebe4 req-ead0c61f-f19e-4735-b604-624271912b5a tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1145.757036] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1145.757036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.757336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.757454] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.757711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.757968] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.758112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.758227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.758434] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.758565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.758694] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.154363] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.154636] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.154767] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.155126] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.155427] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.155597] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.155703] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.155918] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.156131] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.156355] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.156503] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.156573] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.156665] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.156789] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.156864] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.156988] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.183582] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.183764] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.183902] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.184104] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.184432] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.184611] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.184731] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.185098] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.185245] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.261187] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.261345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.261497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.262253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.262421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.262678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.262813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.264693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.264693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.264693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.264693] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1146.293848] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.294104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.294223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.294643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.294866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.305403] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1146.688456] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.688945] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.688945] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.689048] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.689202] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.689395] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 not found, creating... [ 1146.689670] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.689840] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.689977] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.690290] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.690557] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.690806] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.690960] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.691088] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.691310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.691458] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.691600] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 is going to be created. [ 1146.723399] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.723599] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.723677] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.724261] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.724261] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.724408] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.831202] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb in Status: SUCCESS [ 1146.831456] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f8fa77-dfd6-4877-84c2-f9760d23fdfb deletion is rescheduled due to dependency. [ 1146.831646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f8fa77-dfd6-4877-84c2-f9760d23fdfb" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.446842] env[65788]: INFO networking_nsxv3.common.synchronization [req-1ce67f05-9f7f-4ee3-9952-40ca3561ebe4 req-ff9484ce-b648-4ebc-a1a2-1d5e02ed4906 service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 1147.447023] env[65788]: INFO networking_nsxv3.common.synchronization [req-1ce67f05-9f7f-4ee3-9952-40ca3561ebe4 req-ff9484ce-b648-4ebc-a1a2-1d5e02ed4906 service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1147.447151] env[65788]: INFO networking_nsxv3.common.synchronization [req-1ce67f05-9f7f-4ee3-9952-40ca3561ebe4 req-ff9484ce-b648-4ebc-a1a2-1d5e02ed4906 service nova] Enqueued Resource ID: 45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 with Priority: HIGHEST for action port [ 1147.447870] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 1147.447920] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1147.448545] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 with Priority: HIGHEST for action port [ 1147.449843] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.449843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.449843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.450412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.450412] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.451767] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.451767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.451767] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.451767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.451928] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.452169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.452169] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.596977] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 in Status: SUCCESS [ 1147.597245] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baef0a74-ebad-4e33-b0aa-9bf55691a772 deletion is rescheduled due to dependency. [ 1147.597510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baef0a74-ebad-4e33-b0aa-9bf55691a772" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.953886] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.954386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.955403] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 with status ACTIVE [ 1147.955691] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.955888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.956043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.956311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.956406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.956592] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.956707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.956779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.956901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.956995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.957184] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.957289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.957352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.957470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.957541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.957619] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3 is going to be updated. [ 1147.980631] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.980799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.980890] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.981802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.982011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.982229] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45f4ca21-0cee-4ea8-9c57-c8482c2bcfd3" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.317398] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1148.317910] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec deletion is rescheduled due to dependency. [ 1148.318126] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.318497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.318823] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.319083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.321140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.321140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.321140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.321140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.321140] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.362070] env[65788]: INFO networking_nsxv3.common.synchronization [req-1c9c29cf-c1e1-4e1b-a309-34f82d6ffab7 req-56aaaab1-b46b-44b2-b4f2-6f229a3cb3ec tempest-ServersNegativeTestMultiTenantJSON-1460236009 tempest-ServersNegativeTestMultiTenantJSON-1460236009-project-member] Enqueued Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_members [ 1148.362680] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_members [ 1148.363151] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.363513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.363513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.363745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.364657] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.364657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.364657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.364657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.364657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.364657] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.711899] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.712254] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.712478] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.712851] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.713169] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.713393] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.713598] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.713933] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.714385] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.714385] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.714513] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.714618] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.714729] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.714864] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.715017] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.715235] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.742067] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.742351] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.742451] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.742903] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-345" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.743284] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-2e756989-740f-4f26-9fff-7d3dcec7a648 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.743497] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.743677] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.744079] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.744677] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e756989-740f-4f26-9fff-7d3dcec7a648',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.825446] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.868359] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.868567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.868615] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.868897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.868897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.870226] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.870226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.870226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.870226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.870226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.870226] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c already deleted. [ 1148.870226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.247423] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.247816] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.247990] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.248301] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.248568] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.248683] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 2e756989-740f-4f26-9fff-7d3dcec7a648 not found, creating... [ 1149.249472] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.249472] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.249472] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.249767] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.249864] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.250270] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.250499] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.250597] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.250922] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.251132] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.251563] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 2e756989-740f-4f26-9fff-7d3dcec7a648 is going to be created. [ 1149.275924] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.275924] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.275924] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.276258] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.276492] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.276734] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.327460] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.808208] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.808419] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.808543] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.808806] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.809084] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.809249] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.809368] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.809576] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.809723] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.809933] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.810092] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.810197] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.810306] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.810415] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.810519] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.810650] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.830847] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.831117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.831221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.831478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.831589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.831689] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1149.833708] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.833873] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1149.834020] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.834191] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-527" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.834549] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-57eef4ef-59f7-4dbd-8acb-a3a54928f031 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.834774] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.834999] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.835316] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.835482] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57eef4ef-59f7-4dbd-8acb-a3a54928f031',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.872868] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.872868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.872868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.872868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.873445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.884422] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1149.983651] env[65788]: INFO networking_nsxv3.common.synchronization [req-1c9c29cf-c1e1-4e1b-a309-34f82d6ffab7 req-f1b50dd1-550f-4790-b346-c67ffe3b73d5 service nova] Enqueued Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_rules [ 1149.983919] env[65788]: INFO networking_nsxv3.common.synchronization [req-1c9c29cf-c1e1-4e1b-a309-34f82d6ffab7 req-f1b50dd1-550f-4790-b346-c67ffe3b73d5 service nova] Enqueued Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_members [ 1149.984358] env[65788]: INFO networking_nsxv3.common.synchronization [req-1c9c29cf-c1e1-4e1b-a309-34f82d6ffab7 req-f1b50dd1-550f-4790-b346-c67ffe3b73d5 service nova] Enqueued Resource ID: 2e756989-740f-4f26-9fff-7d3dcec7a648 with Priority: HIGHEST for action port [ 1149.985201] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_rules [ 1149.985309] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_members [ 1149.986224] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e756989-740f-4f26-9fff-7d3dcec7a648 with Priority: HIGHEST for action port [ 1149.986224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c2f404-daf6-406a-a4ba-f2e150a0b47c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.986404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.986444] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.987466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.987466] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.991508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.991508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.991508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.991508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.991508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.991508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.991508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.991508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.991508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.991508] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.992851] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e756989-740f-4f26-9fff-7d3dcec7a648 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.993042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.993280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.993517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.993633] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e756989-740f-4f26-9fff-7d3dcec7a648',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.338757] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.339179] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.339226] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.339508] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.339667] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.339980] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.340173] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.340315] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.340565] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.340944] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.341309] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.341456] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.341578] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.341798] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.341925] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.342083] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 is going to be updated. [ 1150.364293] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.364538] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.364666] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.364934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.365239] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.365468] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.489462] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.489606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.493064] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.496247] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e756989-740f-4f26-9fff-7d3dcec7a648 with status ACTIVE [ 1150.496493] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.496726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.496726] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.496896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.496983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.497215] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.497397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.497477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.497651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.497730] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.499819] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.499819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.499819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.499819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.499819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.499819] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e756989-740f-4f26-9fff-7d3dcec7a648 is going to be updated. [ 1150.524864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.525095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.525144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.525328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.525463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.525624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e756989-740f-4f26-9fff-7d3dcec7a648" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.002028] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.064494] env[65788]: INFO networking_nsxv3.common.synchronization [req-5c6b2585-3408-4df3-b98f-6beca5e8838c req-3c0c7688-376a-4a1b-a0d9-e696025aa8b9 service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1151.064684] env[65788]: INFO networking_nsxv3.common.synchronization [req-5c6b2585-3408-4df3-b98f-6beca5e8838c req-3c0c7688-376a-4a1b-a0d9-e696025aa8b9 service nova] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1151.064826] env[65788]: INFO networking_nsxv3.common.synchronization [req-5c6b2585-3408-4df3-b98f-6beca5e8838c req-3c0c7688-376a-4a1b-a0d9-e696025aa8b9 service nova] Enqueued Resource ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 with Priority: HIGHEST for action port [ 1151.065490] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_rules [ 1151.065490] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1151.065683] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 with Priority: HIGHEST for action port [ 1151.065859] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.065943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.066045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.066411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.066411] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.067224] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.067346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.067346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.067900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.067900] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.067900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.067900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.067900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.068503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.068503] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.068827] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-57eef4ef-59f7-4dbd-8acb-a3a54928f031 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.068923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.068992] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.069379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.069379] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57eef4ef-59f7-4dbd-8acb-a3a54928f031',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.509846] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.510191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.510239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.510576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.510736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.510920] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c is going to be created. [ 1151.538708] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.538708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.538708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.538708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.538708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.549209] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c in Status: UNINITIALIZED for 2s [ 1151.577164] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.577164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.577164] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57eef4ef-59f7-4dbd-8acb-a3a54928f031 with status ACTIVE [ 1151.577164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.577164] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.577164] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.577669] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.578289] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.578473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.578697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.578854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.579048] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57eef4ef-59f7-4dbd-8acb-a3a54928f031 is going to be updated. [ 1151.609073] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.609449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.609585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.609943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.610212] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.610470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57eef4ef-59f7-4dbd-8acb-a3a54928f031" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.894546] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1151.894784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.895465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.895524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.895865] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.895865] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.896017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.896124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.896247] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.896318] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.896410] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.082184] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.398413] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.585597] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.586042] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.586084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.586422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.586599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.586835] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1152.620038] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.620241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.620241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.620510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.620828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.634116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1152.900971] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec: rpc.has_security_group_logging(os_id): False [ 1152.920260] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.920446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.920518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.921522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.921522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.921522] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.921522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.921522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.921522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.921522] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.921522] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1152.991495] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.991698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.991698] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.991973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.992163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.006060] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1153.561936] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c in Status: SUCCESS [ 1153.562227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.562765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.563020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.563251] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.563375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.563460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.563600] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.563679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.567031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.567031] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.067274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.067274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.067274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.067786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.067786] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.067786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.067786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.068107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.068107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.068215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.068288] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.068377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.068491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.068612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.069344] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.069344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.069344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.069344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.069344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.069591] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.069591] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.573033] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c2f404-daf6-406a-a4ba-f2e150a0b47c: rpc.has_security_group_logging(os_id): False [ 1154.593539] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.593897] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.594104] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.594493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.594732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.595215] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.596664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.596664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.596664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.596664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.596664] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.596664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.596664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.597130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.597130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.597539] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.597699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.597806] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.598123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.598300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.598472] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c is going to be created. [ 1154.648030] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.648030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.648030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.648030] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.683946] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.684076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.685404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.685404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.685404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.700526] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c in Status: IN_PROGRESS for 2s [ 1155.021753] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1155.021946] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.151983] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.151983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.151983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.152989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.152989] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.152989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.152989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.153290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.153290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.153290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.153497] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.153497] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.153588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.153903] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.154058] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.154158] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.154300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.154462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.154462] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.154555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.154618] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.656709] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5: rpc.has_security_group_logging(os_id): False [ 1155.681401] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.681401] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.681661] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.681697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.681783] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.682049] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.682154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.682209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.682361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.682469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.682643] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.682755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.682818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.682967] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.683091] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.683300] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.683400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.683457] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.683598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.683936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.683936] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1155.777623] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.777856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.777856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.778097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.778313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.799369] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1156.066678] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1156.067381] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1156.707712] env[65788]: INFO networking_nsxv3.common.synchronization [None req-90349f4a-7b70-4a84-90ee-fd49e8996c66 None None] Enqueued Resource ID: 8c550a5c-f83b-4bc8-b161-2cff69bf4b92 with Priority: HIGHEST for action port [ 1156.708342] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c550a5c-f83b-4bc8-b161-2cff69bf4b92 with Priority: HIGHEST for action port [ 1156.708702] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c550a5c-f83b-4bc8-b161-2cff69bf4b92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.709646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c550a5c-f83b-4bc8-b161-2cff69bf4b92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.709646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c550a5c-f83b-4bc8-b161-2cff69bf4b92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.709646] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c550a5c-f83b-4bc8-b161-2cff69bf4b92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.709646] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c550a5c-f83b-4bc8-b161-2cff69bf4b92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.711841] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c in Status: SUCCESS [ 1156.712020] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.213358] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c550a5c-f83b-4bc8-b161-2cff69bf4b92 [ 1157.215040] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.215040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.215040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.215040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.215040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.215040] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c550a5c-f83b-4bc8-b161-2cff69bf4b92 already deleted. [ 1157.215040] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c550a5c-f83b-4bc8-b161-2cff69bf4b92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.398767] env[65788]: INFO networking_nsxv3.common.synchronization [req-ab1c1636-675d-472d-b0fe-c015726a90a4 req-f841b751-6735-4e10-b81d-dcdb41afb4e3 tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_members [ 1157.398767] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 with Priority: HIGHEST for action security_group_members [ 1157.398851] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.399411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.403139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.403445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.403635] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.403749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.403886] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.404204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.404302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.404396] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1dc5fb0-fcac-4a87-8333-bdbc08485f35',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.676616] env[65788]: INFO networking_nsxv3.common.synchronization [None req-59e9bea2-58b8-4a0d-b82c-c1b6a71b439e tempest-ServerActionsV293TestJSON-1628074148 tempest-ServerActionsV293TestJSON-1628074148-project-member] Enqueued Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_rules [ 1157.679136] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_rules [ 1157.679466] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f5de56b-37fa-4340-a555-2a6da1e89c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.679644] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.679708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.679941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.680356] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.789845] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7a6dc00a-0941-45d1-b02f-3c7808218625 tempest-ServerActionsV293TestJSON-1628074148 tempest-ServerActionsV293TestJSON-1628074148-project-member] Enqueued Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_rules [ 1157.792482] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_rules [ 1157.792827] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f5de56b-37fa-4340-a555-2a6da1e89c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.796580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.815652] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1157.815888] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.907277] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.907524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.907595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.907887] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.908043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.908280] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.908417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.908496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.908712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.909024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.909024] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 is going to be updated. [ 1157.943065] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.943065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.943065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.943065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.943492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.952089] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 in Status: IN_PROGRESS for 2s [ 1158.207751] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.207852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.207976] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.208163] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.208306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.208350] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 already deleted. [ 1158.208441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.208592] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.208748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.208831] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.730956] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.730956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.731189] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.731357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.731694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.731802] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 already deleted. [ 1158.732023] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.560696] env[65788]: INFO networking_nsxv3.common.synchronization [None req-7f78856d-17c5-4479-8d07-eaa1ac2f3479 None None] Enqueued Resource ID: b9b802db-ac0a-4dd7-accb-22f55484e787 with Priority: HIGHEST for action port [ 1159.560696] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b802db-ac0a-4dd7-accb-22f55484e787 with Priority: HIGHEST for action port [ 1159.560696] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9b802db-ac0a-4dd7-accb-22f55484e787 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.560696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9b802db-ac0a-4dd7-accb-22f55484e787" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.560696] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9b802db-ac0a-4dd7-accb-22f55484e787" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.561326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9b802db-ac0a-4dd7-accb-22f55484e787" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.561326] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b802db-ac0a-4dd7-accb-22f55484e787',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.961654] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 in Status: SUCCESS [ 1159.961855] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dc5fb0-fcac-4a87-8333-bdbc08485f35 deletion is rescheduled due to dependency. [ 1159.961974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dc5fb0-fcac-4a87-8333-bdbc08485f35" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.063670] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9b802db-ac0a-4dd7-accb-22f55484e787 [ 1160.064031] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.064256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.064383] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.064694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.064824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.064958] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9b802db-ac0a-4dd7-accb-22f55484e787 already deleted. [ 1160.065090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9b802db-ac0a-4dd7-accb-22f55484e787" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.278799] env[65788]: INFO networking_nsxv3.common.synchronization [req-b5dfa595-644f-4237-a5c3-d4cee2b3da4e req-1bfd57da-6918-472f-95a2-cdecb94c105d tempest-ServersNegativeTestMultiTenantJSON-1460236009 tempest-ServersNegativeTestMultiTenantJSON-1460236009-project-member] Enqueued Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_members [ 1164.279400] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c with Priority: HIGHEST for action security_group_members [ 1164.279942] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.280255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.280255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.280344] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.280505] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.280605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.280666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.280807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.280891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.280988] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c2f404-daf6-406a-a4ba-f2e150a0b47c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.787036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.787036] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.787036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.787036] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c is going to be updated. [ 1164.817140] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.817364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.817364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.817641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.817784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.826483] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c in Status: IN_PROGRESS for 2s [ 1166.838199] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c in Status: SUCCESS [ 1166.838602] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c2f404-daf6-406a-a4ba-f2e150a0b47c deletion is rescheduled due to dependency. [ 1166.838602] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c2f404-daf6-406a-a4ba-f2e150a0b47c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.165570] env[65788]: INFO networking_nsxv3.common.synchronization [req-f15ae8cc-ae2f-4cb2-97c6-743cf74bc134 req-c5bf0aa0-a9cb-4db7-ad52-6773bbe207b0 tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1168.166236] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1168.166615] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.166732] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.166807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.167018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.167183] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.167287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.167363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.167579] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.167666] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.167761] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.671025] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.717374] env[65788]: INFO networking_nsxv3.common.synchronization [req-150307fd-e013-4c45-be02-28b1c3ab6f4a req-3dcc5307-139c-4b74-92f7-e28c7942169a tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_members [ 1168.718149] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd with Priority: HIGHEST for action security_group_members [ 1168.718560] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.718724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.718770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.718991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.719152] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.719257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.720081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.720081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.720081] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.720081] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3cbc514-ff92-430a-ae1a-316e49fc6bdd',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.173554] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.224498] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.224498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.224498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.224674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.247817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.248150] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.248280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.248347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.248549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.248634] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.248723] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd is going to be updated. [ 1169.278442] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.278442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.278442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.278442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.278716] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.288741] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd in Status: IN_PROGRESS for 2s [ 1169.676548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.676772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.676824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.677062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.677590] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.677590] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c is going to be updated. [ 1169.707822] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.707990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.708065] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.708266] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.708418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.734128] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: IN_PROGRESS for 2s [ 1171.300721] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd in Status: SUCCESS [ 1171.301011] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3cbc514-ff92-430a-ae1a-316e49fc6bdd deletion is rescheduled due to dependency. [ 1171.301011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3cbc514-ff92-430a-ae1a-316e49fc6bdd" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.744966] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: SUCCESS [ 1171.745255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.719385] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1173.719680] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1174.834675] env[65788]: INFO networking_nsxv3.common.synchronization [None req-fc26019e-9dfc-4eec-95c9-5dc4d5e32e8d tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_rules [ 1174.835240] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_rules [ 1174.835620] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.835720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.835778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.836039] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.836127] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.918836] env[65788]: INFO networking_nsxv3.common.synchronization [None req-80efeb58-92a1-4c03-b22c-889cfe37d3e7 tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_rules [ 1174.919658] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_rules [ 1174.920042] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.920191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.358281] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.358473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.358473] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.358758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.358896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.359050] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 already deleted. [ 1175.359185] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.359379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.359608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.359732] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.538550] env[65788]: INFO networking_nsxv3.common.synchronization [req-611641d2-6f3c-4f4d-b165-3b672a3f1b03 req-9fa98bdb-4073-43b1-9735-e9256ab291ca tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1175.539119] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c with Priority: HIGHEST for action security_group_members [ 1175.540030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.540030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.540030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.540030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.540030] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.540030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.540422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.540538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.540625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.540725] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583dcb2e-0a13-4f7c-8a21-d7c21326fa0c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.881015] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.881015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.881015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.881491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.881491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.881491] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 already deleted. [ 1175.881491] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.045600] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.045761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.045818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.046066] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.046167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.046362] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.046510] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.046588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.046706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.046781] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.046872] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c is going to be updated. [ 1176.096697] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.096856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.096926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.097153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.097300] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.109475] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: IN_PROGRESS for 2s [ 1178.120884] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c in Status: SUCCESS [ 1178.121355] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583dcb2e-0a13-4f7c-8a21-d7c21326fa0c deletion is rescheduled due to dependency. [ 1178.121355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583dcb2e-0a13-4f7c-8a21-d7c21326fa0c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.475479] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.475692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.475823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.476108] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.476375] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.476567] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.476693] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.476920] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.477075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.477317] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.477481] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.477603] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.477713] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.477872] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.477983] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.478124] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.501571] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.501795] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.501908] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.502091] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.502474] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.502647] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.502786] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.503114] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.503303] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.005627] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.006706] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.006706] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.006706] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.006706] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.007102] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.007205] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.007260] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.007505] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.007643] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.007995] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.008163] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.008310] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.008489] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.008620] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.008816] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 is going to be updated. [ 1179.040252] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.040500] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.040602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.040870] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.041075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.041295] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.720662] env[65788]: INFO networking_nsxv3.common.synchronization [req-8648dcce-55c8-4c09-9e7e-1497e2b70c45 req-5ff36615-8ea0-4fe8-a998-5fd3420a1241 service nova] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1179.720927] env[65788]: INFO networking_nsxv3.common.synchronization [req-8648dcce-55c8-4c09-9e7e-1497e2b70c45 req-5ff36615-8ea0-4fe8-a998-5fd3420a1241 service nova] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1179.720963] env[65788]: INFO networking_nsxv3.common.synchronization [req-8648dcce-55c8-4c09-9e7e-1497e2b70c45 req-5ff36615-8ea0-4fe8-a998-5fd3420a1241 service nova] Enqueued Resource ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 with Priority: HIGHEST for action port [ 1179.721211] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_rules [ 1179.721333] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1179.721428] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 with Priority: HIGHEST for action port [ 1179.722660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.722794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.722864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.723072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.723155] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.724720] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.724720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.724720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.724720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.724960] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.725972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.725972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.725972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.725972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.725972] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.726363] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.726363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.727177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.727177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.727177] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.225576] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.225778] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.229167] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 with status ACTIVE [ 1180.229400] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.229544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.229609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.229824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.229914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.230100] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.230218] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.230253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.230400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.230478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.230683] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.230779] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.230835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.230981] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.231068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.231151] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9 is going to be updated. [ 1180.232493] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.252763] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.252918] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.252963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.253190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.253325] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.253493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7b1cc35-ca87-455a-a5d6-c0a5fc77bfd9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.735772] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.101872] env[65788]: INFO networking_nsxv3.common.synchronization [None req-3905b7c3-48d5-4eec-8c3a-35b94a5ce32a tempest-AttachInterfacesTestJSON-818153833 tempest-AttachInterfacesTestJSON-818153833-project-member] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1181.103117] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGHEST for action security_group_members [ 1181.103117] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.103117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.103117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.103412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.103582] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.103690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.103757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.103959] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.104024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.104112] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.238228] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.238408] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.238453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.239041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.239041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.239041] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45f89b37-71e4-413c-a620-b4180609f205 is going to be updated. [ 1181.269272] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.269512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.269575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.269811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.269988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.292578] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: IN_PROGRESS for 2s [ 1181.606713] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.606978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.607072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.607322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.607490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.607660] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.607784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.607836] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.607985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.608093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.608185] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be updated. [ 1181.634717] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.634863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.634935] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.635155] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.635297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.644587] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 2s [ 1183.021929] env[65788]: INFO networking_nsxv3.common.synchronization [req-f056c10e-7669-4eed-a2d3-f3cc0d2480fa req-49821f9d-3192-4ca2-a412-7393654276ab tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_members [ 1183.022521] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_members [ 1183.022837] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.023000] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.023465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.023752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.023922] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.024037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.024103] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.024254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.024360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.024472] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.304677] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: SUCCESS [ 1183.304677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.304677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.304677] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.304931] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.304931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.305029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.305200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.305283] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.305410] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.305545] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.472020] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.472020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.472020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.472020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.472020] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.472020] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.472406] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.472730] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.472993] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.473314] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.473669] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.473864] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.474093] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.474299] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.474494] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.474728] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.494198] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.494362] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.494501] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.494692] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.495015] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-47164887-1a39-499b-892f-55b77aac4790 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.495201] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.495320] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.495691] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.495834] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47164887-1a39-499b-892f-55b77aac4790',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.527081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.527235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.527308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.527515] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.527605] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.527833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.527965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.528041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.528200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.528278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.528364] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 already deleted. [ 1183.528445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.654443] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: IN_PROGRESS for 4s [ 1183.808067] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.003852] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.004123] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.004307] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.004631] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.004823] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.004992] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port 47164887-1a39-499b-892f-55b77aac4790 not found, creating... [ 1184.005357] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.005567] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.005703] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.005923] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.006119] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.006423] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.006640] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.006801] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.007045] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.007239] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.007379] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: 47164887-1a39-499b-892f-55b77aac4790 is going to be created. [ 1184.028166] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.028466] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.028582] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.028876] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.029122] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.029392] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.311499] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45f89b37-71e4-413c-a620-b4180609f205: rpc.has_security_group_logging(os_id): False [ 1184.333028] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.333028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.333028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.333028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.333290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.333418] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.333519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.333621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.333866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.333978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.334118] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45f89b37-71e4-413c-a620-b4180609f205 is going to be updated. [ 1184.406925] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.407160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.407257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.407540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.407746] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.422208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: IN_PROGRESS for 2s [ 1184.785532] env[65788]: INFO networking_nsxv3.common.synchronization [req-f056c10e-7669-4eed-a2d3-f3cc0d2480fa req-aab3b092-15c1-4193-b2f3-27ff74487d50 service nova] Enqueued Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_rules [ 1184.785718] env[65788]: INFO networking_nsxv3.common.synchronization [req-f056c10e-7669-4eed-a2d3-f3cc0d2480fa req-aab3b092-15c1-4193-b2f3-27ff74487d50 service nova] Enqueued Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_members [ 1184.785868] env[65788]: INFO networking_nsxv3.common.synchronization [req-f056c10e-7669-4eed-a2d3-f3cc0d2480fa req-aab3b092-15c1-4193-b2f3-27ff74487d50 service nova] Enqueued Resource ID: 47164887-1a39-499b-892f-55b77aac4790 with Priority: HIGHEST for action port [ 1184.786484] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_rules [ 1184.786661] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_members [ 1184.786778] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47164887-1a39-499b-892f-55b77aac4790 with Priority: HIGHEST for action port [ 1184.787692] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.787692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.787692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.787692] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.787901] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.788789] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.788906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.788972] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.789169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.789328] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.789820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.789820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.789820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.789820] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.789820] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.790812] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-47164887-1a39-499b-892f-55b77aac4790 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.790917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.790983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.791211] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.791540] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47164887-1a39-499b-892f-55b77aac4790',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.293400] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.294666] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.294873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.295232] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47164887-1a39-499b-892f-55b77aac4790 with status ACTIVE [ 1185.295618] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.295854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.295854] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.296084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.296205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.296407] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.296533] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.296607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.296761] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.296841] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.297042] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.297139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.297204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.297338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.297411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.297862] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47164887-1a39-499b-892f-55b77aac4790 is going to be updated. [ 1185.324161] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.324328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.324822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.324822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.324822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.324978] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47164887-1a39-499b-892f-55b77aac4790" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.384619] env[65788]: INFO networking_nsxv3.common.synchronization [req-694ab635-1cb3-4135-a3b7-f2a12f5be866 req-bae16437-30cf-4b6e-aba5-cef943c891f0 tempest-ServerActionsV293TestJSON-1628074148 tempest-ServerActionsV293TestJSON-1628074148-project-member] Enqueued Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_members [ 1185.385890] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_members [ 1185.386670] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de56b-37fa-4340-a555-2a6da1e89c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.386991] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.387269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.387857] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.388262] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.388490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.388665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.389923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.390284] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.390543] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.664831] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 in Status: SUCCESS [ 1185.665039] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 deletion is rescheduled due to dependency. [ 1185.665209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.728697] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-777 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.728929] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-777" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.729074] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-777" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.729417] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-777" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.729694] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.729914] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.730109] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.730372] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.730545] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.730856] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.730998] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.731161] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.731295] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.731431] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.731688] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.731852] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.750985] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.751143] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.751290] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.751540] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-777" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.751937] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-7e600215-dd6b-43f9-af8e-511017644994 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.752149] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.752273] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.752645] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.752779] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e600215-dd6b-43f9-af8e-511017644994',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.795883] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.894159] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.894361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.894361] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.894614] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.894763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.894990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.895162] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.895162] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.895322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.895399] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.895533] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 already deleted. [ 1185.895637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.255515] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.255849] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.255956] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.256259] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.256982] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.256982] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 7e600215-dd6b-43f9-af8e-511017644994 not found, creating... [ 1186.257066] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.257443] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.257679] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.258129] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.258199] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.258519] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.258704] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.259283] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.259283] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.259503] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.259684] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 7e600215-dd6b-43f9-af8e-511017644994 is going to be created. [ 1186.264752] env[65788]: INFO networking_nsxv3.common.synchronization [None req-25430dfb-2402-4d73-be35-9bcc85752d89 None None] Enqueued Resource ID: ea1a20d0-165f-416c-9063-c822d9038c24 with Priority: HIGHEST for action port [ 1186.265505] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1a20d0-165f-416c-9063-c822d9038c24 with Priority: HIGHEST for action port [ 1186.265655] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea1a20d0-165f-416c-9063-c822d9038c24 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.265775] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea1a20d0-165f-416c-9063-c822d9038c24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.265849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea1a20d0-165f-416c-9063-c822d9038c24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.266360] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea1a20d0-165f-416c-9063-c822d9038c24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.266463] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea1a20d0-165f-416c-9063-c822d9038c24',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.282843] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.283140] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.283214] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.283567] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.283802] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.284034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.298221] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.298526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.298526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.298749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.298749] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.298878] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 is going to be created. [ 1186.325416] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.325693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.325693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.325910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.326097] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.339064] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 in Status: UNINITIALIZED for 2s [ 1186.438906] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: SUCCESS [ 1186.438906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.769848] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea1a20d0-165f-416c-9063-c822d9038c24 [ 1186.770167] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.770317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.770390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.770704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.770704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.770811] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea1a20d0-165f-416c-9063-c822d9038c24 already deleted. [ 1186.770898] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea1a20d0-165f-416c-9063-c822d9038c24" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.112050] env[65788]: INFO networking_nsxv3.common.synchronization [req-694ab635-1cb3-4135-a3b7-f2a12f5be866 req-616499b2-339a-47c3-8218-7cd6dbb7a0e6 service nova] Enqueued Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_rules [ 1187.112050] env[65788]: INFO networking_nsxv3.common.synchronization [req-694ab635-1cb3-4135-a3b7-f2a12f5be866 req-616499b2-339a-47c3-8218-7cd6dbb7a0e6 service nova] Enqueued Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_members [ 1187.112050] env[65788]: INFO networking_nsxv3.common.synchronization [req-694ab635-1cb3-4135-a3b7-f2a12f5be866 req-616499b2-339a-47c3-8218-7cd6dbb7a0e6 service nova] Enqueued Resource ID: 7e600215-dd6b-43f9-af8e-511017644994 with Priority: HIGHEST for action port [ 1187.112564] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_rules [ 1187.112948] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_members [ 1187.113418] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e600215-dd6b-43f9-af8e-511017644994 with Priority: HIGHEST for action port [ 1187.113864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f5de56b-37fa-4340-a555-2a6da1e89c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.114221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.114404] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.114722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.116965] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.117923] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de56b-37fa-4340-a555-2a6da1e89c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.118270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.118521] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.118896] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.119489] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.121160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.121160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.121160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.121160] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.121160] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.122545] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e600215-dd6b-43f9-af8e-511017644994 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.122877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.122963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.124031] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.124031] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e600215-dd6b-43f9-af8e-511017644994',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.314864] env[65788]: INFO networking_nsxv3.common.synchronization [None req-312f770d-eabd-4ad4-a8c7-018baeb710f5 tempest-ServersTestManualDisk-1342556756 tempest-ServersTestManualDisk-1342556756-project-member] Enqueued Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_rules [ 1187.314864] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_rules [ 1187.314864] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.314864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.314864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.315348] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.315476] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.407223] env[65788]: INFO networking_nsxv3.common.synchronization [None req-45f737e3-6347-4419-a4ab-2617886e9711 tempest-ServersTestManualDisk-1342556756 tempest-ServersTestManualDisk-1342556756-project-member] Enqueued Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_rules [ 1187.407787] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_rules [ 1187.408069] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.408172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.623045] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.626686] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de56b-37fa-4340-a555-2a6da1e89c90 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.626803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.634419] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e600215-dd6b-43f9-af8e-511017644994 with status ACTIVE [ 1187.634560] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.635472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.635472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.635472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.635472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.635472] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.635472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.635472] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.635789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.635789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.635855] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.635911] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.635943] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.636090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.636169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.636239] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e600215-dd6b-43f9-af8e-511017644994 is going to be updated. [ 1187.659768] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.659950] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.659996] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.660190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.660339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.660492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e600215-dd6b-43f9-af8e-511017644994" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.837847] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.838028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.838100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.838859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.838859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.838859] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 already deleted. [ 1187.838859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.838859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.838859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.839257] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.127929] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.352295] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 in Status: SUCCESS [ 1188.352586] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.352843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.352930] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.354061] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.354061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.354061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.354061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.354061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.354061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.354061] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.362389] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.362389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.362389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.362389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.362389] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.362752] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 already deleted. [ 1188.362752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.631323] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.631527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.631624] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.631877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.631985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.632103] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 is going to be created. [ 1188.660850] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.660986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.661354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.661623] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.661790] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.671992] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 in Status: UNINITIALIZED for 2s [ 1188.834727] env[65788]: INFO networking_nsxv3.common.synchronization [None req-baadecac-839a-4941-9dd2-3e1dcd040385 None None] Enqueued Resource ID: e623b194-a0f2-4977-a66b-e692b0813895 with Priority: HIGHEST for action port [ 1188.835311] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e623b194-a0f2-4977-a66b-e692b0813895 with Priority: HIGHEST for action port [ 1188.835674] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e623b194-a0f2-4977-a66b-e692b0813895 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.835800] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e623b194-a0f2-4977-a66b-e692b0813895" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.835910] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e623b194-a0f2-4977-a66b-e692b0813895" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.836241] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e623b194-a0f2-4977-a66b-e692b0813895" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.836445] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e623b194-a0f2-4977-a66b-e692b0813895',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.856329] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.338715] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e623b194-a0f2-4977-a66b-e692b0813895 [ 1189.338854] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.338999] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.339123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.339370] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.339460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.339559] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e623b194-a0f2-4977-a66b-e692b0813895 already deleted. [ 1189.339647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e623b194-a0f2-4977-a66b-e692b0813895" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.359268] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac26ea2-8225-41e9-86ff-af5852ae5ae4: rpc.has_security_group_logging(os_id): False [ 1189.380588] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.380814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.380931] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.381100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.381210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.381697] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.381844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.381909] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.382157] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.382260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.382337] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 is going to be created. [ 1189.520491] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.520722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.520722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.520917] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.521109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.530877] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 in Status: IN_PROGRESS for 2s [ 1190.685065] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 in Status: SUCCESS [ 1190.685376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.685482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.685956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.686369] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.686581] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.686770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.686994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.687108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.687209] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.687306] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.190162] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.549529] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 in Status: SUCCESS [ 1191.549846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.693723] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f5de56b-37fa-4340-a555-2a6da1e89c90: rpc.has_security_group_logging(os_id): False [ 1191.715631] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.715799] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.715872] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.716203] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.716327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.716612] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.716744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.716813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.717171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.717336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.717467] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 is going to be created. [ 1191.781729] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.781936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.782030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.782285] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.782524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.795663] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 in Status: IN_PROGRESS for 2s [ 1193.810883] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 in Status: SUCCESS [ 1193.810883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.836523] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.836523] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1194.081374] env[65788]: INFO networking_nsxv3.common.synchronization [req-b31c6186-6782-40e8-a9ad-c86677b02580 req-0b052fd3-b77a-4bed-832a-6b69577d846b tempest-ServersTestManualDisk-1342556756 tempest-ServersTestManualDisk-1342556756-project-member] Enqueued Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_members [ 1194.081907] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_members [ 1194.082406] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.082526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.082613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.082901] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.083083] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.083190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.083258] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.083402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.083508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.083717] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.451784] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.452069] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-646" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.452218] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-646" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.452542] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-646" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.452811] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.452970] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.453109] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.453369] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.453499] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.453729] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.453831] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.453935] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.454037] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.454161] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.454244] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.454370] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.473798] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.473798] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1194.474025] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.474117] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-646" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.474448] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-dee67760-88cb-4191-9615-1fad72d2df7a taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.474622] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.474749] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.475084] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.475224] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dee67760-88cb-4191-9615-1fad72d2df7a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.586902] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.587166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.587166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.587386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.587469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.587657] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.587765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.587838] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.587949] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.588028] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.588113] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 already deleted. [ 1194.588192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.798039] env[65788]: INFO networking_nsxv3.common.synchronization [req-d2bc0402-3e01-46c3-a2f8-8a8dc49aa539 req-efe20482-25e4-4f45-ae73-a8841d504429 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_members [ 1194.798883] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGHEST for action security_group_members [ 1194.798883] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.798883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.798883] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.799194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.799194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.799337] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.799380] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.799527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.799598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.799687] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.977612] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.977937] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.978073] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.978278] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.978424] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.978581] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port dee67760-88cb-4191-9615-1fad72d2df7a not found, creating... [ 1194.978860] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.979072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.979196] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.979420] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.979555] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.979838] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.979994] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.980122] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.980322] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.980452] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.980608] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: dee67760-88cb-4191-9615-1fad72d2df7a is going to be created. [ 1195.001066] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.001406] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.001591] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.001962] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.002288] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.002595] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.301960] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.302145] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.302214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.302437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.302536] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.302736] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.302828] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.302906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.303095] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.303169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.303254] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c is going to be updated. [ 1195.334792] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.335128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.335223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.335447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.335650] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.345908] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c in Status: IN_PROGRESS for 2s [ 1195.792835] env[65788]: INFO networking_nsxv3.common.synchronization [req-b31c6186-6782-40e8-a9ad-c86677b02580 req-26844ea7-4f99-45ad-8de8-1a5af78ba5f6 service nova] Enqueued Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_rules [ 1195.792968] env[65788]: INFO networking_nsxv3.common.synchronization [req-b31c6186-6782-40e8-a9ad-c86677b02580 req-26844ea7-4f99-45ad-8de8-1a5af78ba5f6 service nova] Enqueued Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_members [ 1195.793150] env[65788]: INFO networking_nsxv3.common.synchronization [req-b31c6186-6782-40e8-a9ad-c86677b02580 req-26844ea7-4f99-45ad-8de8-1a5af78ba5f6 service nova] Enqueued Resource ID: dee67760-88cb-4191-9615-1fad72d2df7a with Priority: HIGHEST for action port [ 1195.793732] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_rules [ 1195.793873] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_members [ 1195.793968] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dee67760-88cb-4191-9615-1fad72d2df7a with Priority: HIGHEST for action port [ 1195.794919] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.795068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.795150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.795346] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.795428] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.796646] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.796795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.796866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.797063] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.797678] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.797793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.797861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.798098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.798192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.798290] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.799155] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-dee67760-88cb-4191-9615-1fad72d2df7a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.799270] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.799336] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.799489] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.799565] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dee67760-88cb-4191-9615-1fad72d2df7a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.302539] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.302539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.302539] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.303536] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dee67760-88cb-4191-9615-1fad72d2df7a with status ACTIVE [ 1196.303722] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.303822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.303889] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.304120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.304234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.304899] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.304899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.304899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.304899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.305250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.305283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.305390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.305508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.305766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.306654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.306654] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dee67760-88cb-4191-9615-1fad72d2df7a is going to be updated. [ 1196.331033] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.331208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.331208] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.331375] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.331541] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.331676] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dee67760-88cb-4191-9615-1fad72d2df7a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.808441] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.310799] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.311116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.311116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.311323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.311323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.311484] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 is going to be created. [ 1197.337043] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.337246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.337246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.337461] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.337625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.357787] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 in Status: UNINITIALIZED for 2s [ 1197.360502] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c in Status: SUCCESS [ 1197.360904] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c deletion is rescheduled due to dependency. [ 1197.361064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.376027] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 in Status: SUCCESS [ 1199.376394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.376437] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.376665] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.376953] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.377085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.377128] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.377311] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.377391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.377535] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.377647] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.879860] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.302792] env[65788]: INFO networking_nsxv3.common.synchronization [req-d3bbe683-329a-4785-b491-ba86be49f61d req-518c2ef6-1e57-4f6f-bfeb-e63b40ae9dbb tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1200.303346] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1200.303645] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.303765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.303835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.304137] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.304214] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.304280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.304341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.304486] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.304610] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.304659] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.381881] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a21e4fff-6a13-4f07-b2f4-df10109513b4: rpc.has_security_group_logging(os_id): False [ 1200.400959] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.401134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.401206] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.401422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.401514] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.401785] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.401849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.401913] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.402130] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.402174] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.402307] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 is going to be created. [ 1200.464319] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.464584] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.465118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.465118] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.465350] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.478340] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 in Status: IN_PROGRESS for 2s [ 1200.807070] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.308965] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.811798] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.812262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.812262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.812262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.812388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.812513] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf is going to be updated. [ 1201.842851] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.843116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.843116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.843287] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.843427] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.854726] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: IN_PROGRESS for 2s [ 1202.491874] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 in Status: SUCCESS [ 1202.492147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.864607] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: SUCCESS [ 1203.864607] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.304674] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.305146] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1210.305685] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.306104] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1214.485332] env[65788]: INFO networking_nsxv3.common.synchronization [req-524694b8-49d5-4f0e-a781-db5a6a13297d req-8c4d2611-63db-464b-95ff-8f271773c361 tempest-AttachVolumeTestJSON-303982689 tempest-AttachVolumeTestJSON-303982689-project-member] Enqueued Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_members [ 1214.485332] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGHEST for action security_group_members [ 1214.485332] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.485332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.485332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.485332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.485687] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.485687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.485687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.485914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.485914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.485914] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.988617] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.988832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.988832] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.989084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.989176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.989380] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.989481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.989545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.989701] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.989777] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.989862] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 is going to be updated. [ 1215.025234] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.025397] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.025440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.025652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.025989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.034815] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e84459-f201-4bd5-a48a-e23c87203964 in Status: IN_PROGRESS for 2s [ 1216.269976] env[65788]: INFO networking_nsxv3.common.synchronization [req-6973f8ee-105b-4d3a-a6a9-e25db990eade req-d38a9be2-0056-43a8-be98-46097a60b35e tempest-ServerActionsTestOtherA-603280157 tempest-ServerActionsTestOtherA-603280157-project-member] Enqueued Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1216.270697] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf with Priority: HIGHEST for action security_group_members [ 1216.271067] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.271200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.271301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.272068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.272068] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.272068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.272068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.272068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.272068] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.272542] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.775345] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.775512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.775588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.775807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.775929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.776157] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.776262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.776323] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.776478] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.776555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.776644] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf is going to be updated. [ 1216.817045] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.817273] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.817388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.817642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.817839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.826801] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: IN_PROGRESS for 2s [ 1217.045769] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1e84459-f201-4bd5-a48a-e23c87203964 in Status: SUCCESS [ 1217.045981] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 deletion is rescheduled due to dependency. [ 1217.046041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.836904] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf in Status: SUCCESS [ 1218.837237] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf deletion is rescheduled due to dependency. [ 1218.837237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.272119] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.272392] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1226.273332] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1226.273332] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.128137] env[65788]: INFO networking_nsxv3.common.synchronization [req-f547a485-370d-4e94-b3ba-ede9be1101b3 req-61e2c72b-fd16-4c5e-9287-5ece0fc0add0 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1230.128631] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1230.128927] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.129169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.129297] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.129453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.129684] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.129747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.129787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.129906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.129990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.130940] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.633409] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.633637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.633711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.633952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.634085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.634312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.634512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.634512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.634655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.634729] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.635516] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1230.674581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.674757] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.674835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.675082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.675257] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.685090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1232.697928] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1232.698357] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d deletion is rescheduled due to dependency. [ 1232.698357] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.130082] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.130483] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.567459] env[65788]: INFO networking_nsxv3.common.synchronization [req-6e59e824-8674-46a8-a76d-098f013451d0 req-6500d28d-8d21-4151-a559-eee7ffe19a4c tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1237.568398] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f89b37-71e4-413c-a620-b4180609f205 with Priority: HIGHEST for action security_group_members [ 1237.569090] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-45f89b37-71e4-413c-a620-b4180609f205 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.569090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.569090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.569330] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.569368] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.569519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.569519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.570267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.570267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.570267] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45f89b37-71e4-413c-a620-b4180609f205',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.072833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.072993] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.073074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.073276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.073367] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.073565] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.073671] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.073724] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.073861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.073934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.074066] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45f89b37-71e4-413c-a620-b4180609f205 is going to be updated. [ 1238.102230] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.102376] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.102448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.102652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.102794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.111722] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: IN_PROGRESS for 2s [ 1238.999303] env[65788]: INFO networking_nsxv3.common.synchronization [req-f97c5341-763f-4679-aca0-a70a5d345ae8 req-21be80ec-4f41-4841-8c24-606f3fd6d198 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1239.000585] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1239.000585] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.000585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.000722] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.001359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.001359] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.001359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.001359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.001583] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.002880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.002880] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.363018] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.363288] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.363451] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.363792] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.364387] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.364600] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.364748] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.365027] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.365215] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.365705] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.365705] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.365849] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.365902] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.366017] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.366243] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.366425] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.388473] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.388674] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1239.388764] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.388985] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.389416] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-3239f7ee-9b30-463a-abf4-c560a898ea75 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.389602] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.389715] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.390157] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.390283] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3239f7ee-9b30-463a-abf4-c560a898ea75',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.505070] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.505264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.505264] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.505483] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.505575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.505774] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.505873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.505937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.506101] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.506240] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.506330] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1239.533556] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.533771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.533771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.533971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.534177] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.543172] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1239.892778] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.892972] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.893040] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.893349] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.893524] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.893709] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 3239f7ee-9b30-463a-abf4-c560a898ea75 not found, creating... [ 1239.894057] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.894270] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.894343] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.894614] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.894756] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.895079] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.895292] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.895425] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.895664] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.895828] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.896008] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 3239f7ee-9b30-463a-abf4-c560a898ea75 is going to be created. [ 1239.918644] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.919051] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.919051] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.919381] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.919554] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.919775] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.122685] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45f89b37-71e4-413c-a620-b4180609f205 in Status: SUCCESS [ 1240.123168] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45f89b37-71e4-413c-a620-b4180609f205 deletion is rescheduled due to dependency. [ 1240.123168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45f89b37-71e4-413c-a620-b4180609f205" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.645767] env[65788]: INFO networking_nsxv3.common.synchronization [req-f97c5341-763f-4679-aca0-a70a5d345ae8 req-4870d8cc-165f-4234-ad1f-dc6e77bc84e0 service nova] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 1240.646069] env[65788]: INFO networking_nsxv3.common.synchronization [req-f97c5341-763f-4679-aca0-a70a5d345ae8 req-4870d8cc-165f-4234-ad1f-dc6e77bc84e0 service nova] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1240.646288] env[65788]: INFO networking_nsxv3.common.synchronization [req-f97c5341-763f-4679-aca0-a70a5d345ae8 req-4870d8cc-165f-4234-ad1f-dc6e77bc84e0 service nova] Enqueued Resource ID: 3239f7ee-9b30-463a-abf4-c560a898ea75 with Priority: HIGHEST for action port [ 1240.647017] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 1240.647226] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1240.647401] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3239f7ee-9b30-463a-abf4-c560a898ea75 with Priority: HIGHEST for action port [ 1240.648833] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.648833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.648833] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.648989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.648989] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.650255] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.650382] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.650665] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-3239f7ee-9b30-463a-abf4-c560a898ea75 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.650826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.650936] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.651195] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.651300] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3239f7ee-9b30-463a-abf4-c560a898ea75',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.153702] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.154181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.154181] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3239f7ee-9b30-463a-abf4-c560a898ea75 with status ACTIVE [ 1241.154411] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.154540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.154613] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.154826] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.154914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.155112] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.155214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.155278] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.155431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.155509] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.155696] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.157791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.157791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.157791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.157791] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.157791] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3239f7ee-9b30-463a-abf4-c560a898ea75 is going to be updated. [ 1241.178845] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.179057] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.179192] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.179368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.179542] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.179737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3239f7ee-9b30-463a-abf4-c560a898ea75" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.554846] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1241.555072] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d deletion is rescheduled due to dependency. [ 1241.555187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.555368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.555609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.555859] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.555994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.556080] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.556343] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.556498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.556573] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.059235] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.343637] env[65788]: INFO networking_nsxv3.common.synchronization [None req-067e5587-ad8f-488c-a28e-65c0369b0c29 tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1242.344261] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1242.344575] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.345111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.345235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.345576] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.345732] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.435749] env[65788]: INFO networking_nsxv3.common.synchronization [None req-e9b56e9f-3301-496d-81c3-add283f243a5 tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1242.436368] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1242.436663] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.436773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.562019] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.865548] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.865700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.865700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.865862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.865952] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.866060] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 already deleted. [ 1242.866216] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.866386] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.866551] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.866634] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.064352] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.064549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.064612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.064866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.064958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.065089] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1243.111147] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.111352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.111352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.111526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.111704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.123252] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1243.392619] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.392619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.393288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.393288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.393288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.393288] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 already deleted. [ 1243.393288] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.478367] env[65788]: INFO networking_nsxv3.common.synchronization [req-6ca4f70b-1a23-4835-9a5b-b35c6d189f34 req-2684a551-c530-4122-b5da-79e4f914eab3 tempest-ServersTestManualDisk-1342556756 tempest-ServersTestManualDisk-1342556756-project-member] Enqueued Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_members [ 1243.478367] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGHEST for action security_group_members [ 1243.478367] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.478534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.478534] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.478642] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.478941] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.478941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.478941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.479179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.479276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.479376] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.982097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.982255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.982255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.982469] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.982555] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.982748] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.982844] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.982905] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.983693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.983693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.983693] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 is going to be updated. [ 1244.011865] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.012029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.012099] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.012349] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.012572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.021835] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 in Status: IN_PROGRESS for 2s [ 1245.133228] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1245.133528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.133649] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.133863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.134095] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.134231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.134291] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.134433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.134525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.134601] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.134694] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.534403] env[65788]: INFO networking_nsxv3.common.synchronization [req-aeaa93e2-1c16-4532-a7e1-96103fa784e2 req-51edc51f-3fbc-4fc5-873d-6efe5b125f96 tempest-ServerActionsV293TestJSON-1628074148 tempest-ServerActionsV293TestJSON-1628074148-project-member] Enqueued Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_members [ 1245.534934] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 with Priority: HIGHEST for action security_group_members [ 1245.536029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de56b-37fa-4340-a555-2a6da1e89c90 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.536029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.536029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.536029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.536029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.536029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.536377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.536463] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.537131] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.537131] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de56b-37fa-4340-a555-2a6da1e89c90',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.637930] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.035600] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 in Status: SUCCESS [ 1246.036262] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 deletion is rescheduled due to dependency. [ 1246.036356] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.038837] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.038979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.039086] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.039302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.039402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.039599] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.039700] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.039764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.039933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.040018] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.040116] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 is going to be updated. [ 1246.074644] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.074822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.074915] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.075168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.075493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.085014] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 in Status: IN_PROGRESS for 2s [ 1246.140596] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78cf75a9-6fba-4c9b-bfad-3d1090cb819d: rpc.has_security_group_logging(os_id): False [ 1246.162047] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.162220] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.162295] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.162558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.162662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.163136] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.163136] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.163317] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.163715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.163715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.163715] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1246.245081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.245334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.245334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.245474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.245622] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.260721] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1248.096884] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 in Status: SUCCESS [ 1248.097282] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de56b-37fa-4340-a555-2a6da1e89c90 deletion is rescheduled due to dependency. [ 1248.097282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de56b-37fa-4340-a555-2a6da1e89c90" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.275529] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1248.275756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.065746] env[65788]: INFO networking_nsxv3.common.synchronization [req-3e504572-5954-4fe5-8e1c-a4da166dd563 req-a6c69867-1a71-4449-8a25-a2815575c5c8 tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1250.066325] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1250.066630] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.066753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.066817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.067017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.067205] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.067321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.067431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.067604] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.067715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.067871] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.570648] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.571183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.571183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.571183] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.571340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.571400] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.571519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.571588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.571748] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.571814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.571898] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1250.602592] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.602767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.602831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.603024] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.603182] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.612115] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1250.676087] env[65788]: INFO networking_nsxv3.common.synchronization [req-1313cabd-d338-4258-94ac-8e91d997451b req-c46a6c3a-b6f8-4820-af91-ee031ce2a3ef tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1250.676524] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1250.676885] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.677107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.677107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.677364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.677523] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.677641] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.677709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.677879] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.677964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.678093] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.052471] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.052471] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.052642] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.052770] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.053556] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.053556] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.053556] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.053863] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.053863] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.053991] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.054118] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.054264] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.054365] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.054473] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.054573] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.054697] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.077144] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.077498] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.077498] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.077628] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.077947] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-e411457e-0a0f-4150-8023-0de1113795c9 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.078132] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.078252] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.078579] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.078715] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e411457e-0a0f-4150-8023-0de1113795c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.180708] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.181310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.181310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.181310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.181310] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.181508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.181572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.181609] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.181737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.181810] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.181895] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 already deleted. [ 1251.181977] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.377986] env[65788]: INFO networking_nsxv3.common.synchronization [req-43396147-4587-4f22-bc2a-41cc084d02bd req-2cdbba2f-93b9-4e0e-934c-797d0427f7ea tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_members [ 1251.378643] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGHEST for action security_group_members [ 1251.378838] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.378988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.379263] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.379487] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.380060] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.380060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.380060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.380060] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.380338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.380338] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.581429] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.581664] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.581790] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.582082] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.582250] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.582536] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Segment Port e411457e-0a0f-4150-8023-0de1113795c9 not found, creating... [ 1251.582625] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.582785] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.582900] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.583138] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.583273] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.583552] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.583815] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.583815] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.584019] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.584153] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.584309] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: e411457e-0a0f-4150-8023-0de1113795c9 is going to be created. [ 1251.605354] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.605552] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.605681] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.605954] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.606203] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.606480] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.882632] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.882856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.882856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.883110] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.883205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.883422] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.883527] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.883589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.883756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.883829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.883915] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 is going to be updated. [ 1251.919194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.919363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.919958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.919958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.919958] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.928229] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 in Status: IN_PROGRESS for 2s [ 1252.340411] env[65788]: INFO networking_nsxv3.common.synchronization [req-1313cabd-d338-4258-94ac-8e91d997451b req-b88c13e3-92ee-4dbe-94bc-e9f52c7cc089 service nova] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1252.340685] env[65788]: INFO networking_nsxv3.common.synchronization [req-1313cabd-d338-4258-94ac-8e91d997451b req-b88c13e3-92ee-4dbe-94bc-e9f52c7cc089 service nova] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1252.340748] env[65788]: INFO networking_nsxv3.common.synchronization [req-1313cabd-d338-4258-94ac-8e91d997451b req-b88c13e3-92ee-4dbe-94bc-e9f52c7cc089 service nova] Enqueued Resource ID: e411457e-0a0f-4150-8023-0de1113795c9 with Priority: HIGHEST for action port [ 1252.341364] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1252.341524] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1252.341692] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e411457e-0a0f-4150-8023-0de1113795c9 with Priority: HIGHEST for action port [ 1252.342029] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.342029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.342029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.342228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.342299] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.343203] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.343322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.344172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.344172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.344172] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.344172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.344172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.344172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.344172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.344172] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.345156] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e411457e-0a0f-4150-8023-0de1113795c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.345156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.345156] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.345328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.345328] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e411457e-0a0f-4150-8023-0de1113795c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.622408] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1252.622648] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec deletion is rescheduled due to dependency. [ 1252.622842] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.847440] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.848542] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.849238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.849238] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e411457e-0a0f-4150-8023-0de1113795c9 with status ACTIVE [ 1252.849238] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.849238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.849238] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.849526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.849526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.849615] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.849707] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.849770] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.849914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.850019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.850169] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.850771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.850771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.850771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.850771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.850771] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e411457e-0a0f-4150-8023-0de1113795c9 is going to be updated. [ 1252.871076] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.871246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.871304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.871674] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.871744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.871937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.353246] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.858755] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.858968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.859062] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.859292] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.859388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.859494] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 is going to be created. [ 1253.881853] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.882019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.882093] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.882308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.882504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.892349] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: UNINITIALIZED for 2s [ 1253.936184] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 in Status: SUCCESS [ 1253.936386] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 deletion is rescheduled due to dependency. [ 1253.936503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.903210] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: SUCCESS [ 1255.903523] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.904205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.904205] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.904503] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.904503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.904503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.904684] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.904718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.904804] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.904882] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.407441] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.913256] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9: rpc.has_security_group_logging(os_id): False [ 1256.930990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.931223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.931223] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.931446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.931575] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.932081] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.932228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.932327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.932531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.932643] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.932760] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 is going to be created. [ 1256.994339] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.994339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.994339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.994339] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.994633] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.006992] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: IN_PROGRESS for 2s [ 1257.342178] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.342354] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1257.790775] env[65788]: INFO networking_nsxv3.common.synchronization [None req-154f9e51-20ad-430a-b173-b9e1113a5015 tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_rules [ 1257.791307] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_rules [ 1257.791586] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e44bfaf3-33b0-464c-89a8-bab12493422a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.791687] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.791811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.792082] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.792165] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.891758] env[65788]: INFO networking_nsxv3.common.synchronization [None req-116ea243-a15b-4593-a1b9-40393d942732 tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_rules [ 1257.892363] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_rules [ 1257.892705] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e44bfaf3-33b0-464c-89a8-bab12493422a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.892829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.008291] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1258.008676] env[65788]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5515068e-0c5b-4e4c-984f-c199c981536a None None] NSXv3 Agent Agent loop - iteration:3 started [ 1258.314333] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.314498] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.314537] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.314845] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.315015] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.315150] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e44bfaf3-33b0-464c-89a8-bab12493422a already deleted. [ 1258.315265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.315474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.315970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.316109] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.838715] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.838715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.838715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.838715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.838715] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.839120] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e44bfaf3-33b0-464c-89a8-bab12493422a already deleted. [ 1258.839120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.022349] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: SUCCESS [ 1259.022710] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.398052] env[65788]: INFO networking_nsxv3.common.synchronization [req-cf75d14b-e9c5-49b6-982c-66a45afb9ca0 req-c40461ed-d2f0-4928-be5e-6078bb2bf5f1 tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1261.398520] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1261.398916] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.399070] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.399169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.399364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.400027] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.400027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.400027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.400027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.400027] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.400283] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.738034] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.738034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.738034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.738034] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.738034] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.738422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.738717] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.738896] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.739056] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.739270] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1261.739381] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1261.739485] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1261.739593] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1261.739700] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1261.739804] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1261.739936] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1261.760015] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1261.760184] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1261.760323] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1261.760492] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.760799] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-99ba3884-6c7e-42a5-9836-1d435c1734e1 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.760971] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.761101] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.761436] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.761639] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ba3884-6c7e-42a5-9836-1d435c1734e1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.902815] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.902985] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.903096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.903313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.903843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.903843] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.903843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.903843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.904043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.904043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.904100] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1261.929729] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.929941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.929941] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.930176] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.930316] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.939565] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1262.263635] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.263927] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.264081] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.264384] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.264535] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.264690] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 99ba3884-6c7e-42a5-9836-1d435c1734e1 not found, creating... [ 1262.264946] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.265114] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.265229] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.265483] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.265630] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.265910] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.266081] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.266208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.266445] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.266582] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.266720] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 is going to be created. [ 1262.286188] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.286442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.286684] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.286950] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.287198] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.287474] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.003236] env[65788]: INFO networking_nsxv3.common.synchronization [req-cf75d14b-e9c5-49b6-982c-66a45afb9ca0 req-d49ab69c-9065-4c56-9cfe-cbda3621ab9b service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 1263.003236] env[65788]: INFO networking_nsxv3.common.synchronization [req-cf75d14b-e9c5-49b6-982c-66a45afb9ca0 req-d49ab69c-9065-4c56-9cfe-cbda3621ab9b service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1263.003236] env[65788]: INFO networking_nsxv3.common.synchronization [req-cf75d14b-e9c5-49b6-982c-66a45afb9ca0 req-d49ab69c-9065-4c56-9cfe-cbda3621ab9b service nova] Enqueued Resource ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 with Priority: HIGHEST for action port [ 1263.003748] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 1263.003905] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1263.003967] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 with Priority: HIGHEST for action port [ 1263.004340] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.004402] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.004448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.004629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.004710] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.005975] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.006190] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.007044] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ba3884-6c7e-42a5-9836-1d435c1734e1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.007044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.007044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.007044] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.007044] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ba3884-6c7e-42a5-9836-1d435c1734e1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.507013] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.507153] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.508543] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99ba3884-6c7e-42a5-9836-1d435c1734e1 with status ACTIVE [ 1263.508740] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.508862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.508929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.509159] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.509248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.509420] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.509547] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.509612] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.509771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.509851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.510075] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.510127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.510191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.510332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.510425] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.510485] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 is going to be updated. [ 1263.534682] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.534682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.534829] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.535071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.535213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.535384] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.571193] env[65788]: INFO networking_nsxv3.common.synchronization [req-3f807919-eacb-4f3c-a52a-a60954fb0409 req-5f278dd7-3c37-467a-867a-924ecef1d932 tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_members [ 1263.571653] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_members [ 1263.571950] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e44bfaf3-33b0-464c-89a8-bab12493422a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.572085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.572150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.572396] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.572558] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.572654] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.572714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.572862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.572970] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.573110] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.884338] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.884536] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.884640] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.885017] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.885311] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.885473] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.885588] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.885805] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.885942] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.886158] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.886266] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.886370] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.886571] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.886686] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.886790] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.886917] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.906747] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.906909] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1263.907100] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.907285] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-625" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.907687] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-30632121-cac4-453d-bd28-8c90ea808f8f taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.907860] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.907979] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.908344] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.908538] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30632121-cac4-453d-bd28-8c90ea808f8f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.949309] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1263.949499] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec deletion is rescheduled due to dependency. [ 1263.949616] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.949795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.950046] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.950237] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.950359] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.950433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.950585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.950669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.950765] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.075140] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.075482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.075482] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.075792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.075939] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.076252] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.076426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.076511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.076744] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.076856] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.076977] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e44bfaf3-33b0-464c-89a8-bab12493422a already deleted. [ 1264.077098] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.410992] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.411199] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.411311] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.411591] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.411740] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.411898] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 30632121-cac4-453d-bd28-8c90ea808f8f not found, creating... [ 1264.412169] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.412326] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.412441] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.412657] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.412791] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.413083] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.413237] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.413372] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.413579] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.413730] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.413840] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 30632121-cac4-453d-bd28-8c90ea808f8f is going to be created. [ 1264.433868] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.434113] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.434206] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.434592] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.434837] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.435075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.452533] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.954687] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.137921] env[65788]: INFO networking_nsxv3.common.synchronization [req-3f807919-eacb-4f3c-a52a-a60954fb0409 req-6ff2188c-78d1-4363-86f4-43cf452ebb06 service nova] Enqueued Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_rules [ 1265.138209] env[65788]: INFO networking_nsxv3.common.synchronization [req-3f807919-eacb-4f3c-a52a-a60954fb0409 req-6ff2188c-78d1-4363-86f4-43cf452ebb06 service nova] Enqueued Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_members [ 1265.138260] env[65788]: INFO networking_nsxv3.common.synchronization [req-3f807919-eacb-4f3c-a52a-a60954fb0409 req-6ff2188c-78d1-4363-86f4-43cf452ebb06 service nova] Enqueued Resource ID: 30632121-cac4-453d-bd28-8c90ea808f8f with Priority: HIGHEST for action port [ 1265.138772] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_rules [ 1265.138918] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_members [ 1265.139036] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30632121-cac4-453d-bd28-8c90ea808f8f with Priority: HIGHEST for action port [ 1265.139312] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e44bfaf3-33b0-464c-89a8-bab12493422a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.139459] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.139511] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.139712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.139766] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.140646] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e44bfaf3-33b0-464c-89a8-bab12493422a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.141493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.141493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.141493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.141493] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.141493] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.141851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.141851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.141851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.141945] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.143209] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-30632121-cac4-453d-bd28-8c90ea808f8f taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.143321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.143363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.143965] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.143965] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30632121-cac4-453d-bd28-8c90ea808f8f',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.457309] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.457599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.457599] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.457871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.457995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.458148] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1265.487626] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.487859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.487908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.488140] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.488328] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.496978] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1265.646459] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e44bfaf3-33b0-464c-89a8-bab12493422a taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.646564] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.646761] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.647716] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30632121-cac4-453d-bd28-8c90ea808f8f with status ACTIVE [ 1265.648121] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.648121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.648121] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.648326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.648409] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.648586] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.648679] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.648740] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.648893] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.648971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.649174] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.649267] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.649327] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.649466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.649540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.649635] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30632121-cac4-453d-bd28-8c90ea808f8f is going to be updated. [ 1265.671670] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.671755] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.671797] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.671968] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.672120] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.672269] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30632121-cac4-453d-bd28-8c90ea808f8f" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.152184] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.655502] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.655745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.655745] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.655947] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.656058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.656165] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e44bfaf3-33b0-464c-89a8-bab12493422a is going to be created. [ 1266.682584] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.682765] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.682880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.683141] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.683366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.694381] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e44bfaf3-33b0-464c-89a8-bab12493422a in Status: UNINITIALIZED for 2s [ 1267.507374] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1267.507690] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.507747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.508036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.508275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.508422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.508496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.508669] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.508752] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.508837] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.508947] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.011539] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.514237] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec: rpc.has_security_group_logging(os_id): False [ 1268.534803] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.535064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.535064] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.535239] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.535333] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.535595] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.535720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.535768] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.535906] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.535974] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.536082] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1268.595531] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.595758] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.595807] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.596150] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.596345] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.610727] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1268.703577] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e44bfaf3-33b0-464c-89a8-bab12493422a in Status: SUCCESS [ 1268.703789] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.703969] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.704214] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.704419] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.704539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.704608] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.704780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.704859] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.704945] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.705065] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.207303] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.710011] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e44bfaf3-33b0-464c-89a8-bab12493422a: rpc.has_security_group_logging(os_id): False [ 1269.728262] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.729041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.729041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.729041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.729041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.729041] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.729275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.729275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.729275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.729365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.729735] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e44bfaf3-33b0-464c-89a8-bab12493422a is going to be created. [ 1269.792673] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.792908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.792908] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.793117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.793299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.808165] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e44bfaf3-33b0-464c-89a8-bab12493422a in Status: IN_PROGRESS for 2s [ 1270.139969] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.140144] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1270.629314] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1270.629314] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.821148] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e44bfaf3-33b0-464c-89a8-bab12493422a in Status: SUCCESS [ 1271.821418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.141439] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.141811] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.143105] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.143415] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.144360] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.144772] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.145700] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.145983] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.948272] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.948742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.948742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.948742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.948855] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.451417] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.954307] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.146864] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.146948] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.456454] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1295.456668] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1296.253581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.254058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.254058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.254058] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.267505] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1296.268477] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.269431] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1296.308016] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.308261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.308261] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.308428] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.319466] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.320290] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1296.320377] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.320470] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1296.358745] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.359026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.359026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.359210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.360539] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.360715] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1296.441453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.441699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.441699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.441861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.442200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.442527] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1296.534726] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.534963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.535051] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.535213] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.535559] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.535926] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1296.536139] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7b366224-1a8e-4eba-8bca-4fdd69ef52e9', '1ac26ea2-8225-41e9-86ff-af5852ae5ae4', '975f007e-412c-4399-9443-27166cb23d7c', '21d7211d-4d95-4d68-a449-61e8c3acb85c', 'a1e84459-f201-4bd5-a48a-e23c87203964', '5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec', 'a21e4fff-6a13-4f07-b2f4-df10109513b4', '78cf75a9-6fba-4c9b-bfad-3d1090cb819d', '1f4eed26-2bee-4114-b8b7-1b3c1d2368c9', '7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5', '43c86f5e-5e15-4193-915e-454c2a0bcd6a', '0192141c-b766-4f81-bfc9-7eab487b7c37', '312ecf31-d6a5-4636-8de5-71be8f37e76e', '1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1', '61c7676a-9165-4a1a-b58b-8faa9c5567b8', 'e17b3806-a6cb-4d6d-91a2-9df7fad51245', 'e2ded108-574f-4c27-b008-f6c2b759b560', 'd22e7a7e-27b7-45b2-ac98-bd568f361a92', 'adb68513-ddb5-44a7-8610-69e7dc83ba07', '41bb08da-7387-43a0-b7d4-fffc0c3a3846', '2f5de56b-37fa-4340-a555-2a6da1e89c90', '2d32ada3-2c5d-4fb9-be7d-5b4b5294bd30', '482328ee-c8ae-447e-af1f-c321cd088282', '64f8fa77-dfd6-4877-84c2-f9760d23fdfb', '6e122c7c-4854-48e9-8b30-d71e6fb4283b', 'b8706ce6-3bf4-4bd2-b7f4-8aa12fcd36bf', 'e3cbc514-ff92-430a-ae1a-316e49fc6bdd', '88a0f6ea-2705-4f7e-89ce-48ee3f2db28c', '5d96e629-2a5d-4253-97dc-c6a3cd034461', '60331e89-d7f7-4118-84ff-3c2694ae8888', 'f3c2f404-daf6-406a-a4ba-f2e150a0b47c', '583dcb2e-0a13-4f7c-8a21-d7c21326fa0c', '1723657c-045d-4e76-905a-f1602b6cbec4', '605d7441-fa35-48f3-be10-861643ff1c6c', '900e89d4-a148-4692-80f4-3bd065e8007a', 'a40ffece-b7ec-436b-a9b9-603ca8f67c90', 'baef0a74-ebad-4e33-b0aa-9bf55691a772', 'e44bfaf3-33b0-464c-89a8-bab12493422a', 'b1dc5fb0-fcac-4a87-8333-bdbc08485f35', '45f89b37-71e4-413c-a620-b4180609f205', '07ea6710-254c-4bc8-955c-3558da8ea95b', 'e17bee3e-2368-47f5-851f-96deb4d04a56', '5c2d9519-fb22-49d0-a2e2-a6d300763f8c', '478cab84-cb72-4b89-ac1a-ce3970d7f356'} {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.536276] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1296.555248] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.555516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.555516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.555664] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.555734] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.555849] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1296.555929] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.556025] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1296.644348] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.644640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.644640] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.644822] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.646049] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.646342] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1296.646421] env[65788]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65788) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.646487] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1296.646556] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1296.646679] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1296.646757] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGH for action security_group_rules [ 1296.646844] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGH for action security_group_rules [ 1296.646894] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGH for action security_group_rules [ 1296.646959] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGH for action security_group_rules [ 1296.647029] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGH for action security_group_rules [ 1296.647094] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGH for action security_group_rules [ 1296.647148] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGH for action security_group_rules [ 1296.647214] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGH for action security_group_rules [ 1296.647273] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGH for action security_group_rules [ 1296.647332] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGH for action security_group_rules [ 1296.647435] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGH for action security_group_rules [ 1296.647483] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGH for action security_group_rules [ 1296.647518] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGH for action security_group_rules [ 1296.647561] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGH for action security_group_rules [ 1296.647632] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGH for action security_group_rules [ 1296.647690] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGH for action security_group_rules [ 1296.647794] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGH for action security_group_rules [ 1296.647794] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGH for action security_group_rules [ 1296.647911] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGH for action security_group_rules [ 1296.647959] env[65788]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGH for action security_group_rules [ 1296.648029] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.147747] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.148085] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1300.148085] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 with Priority: HIGH for action security_group_rules [ 1300.148170] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975f007e-412c-4399-9443-27166cb23d7c with Priority: HIGH for action security_group_rules [ 1300.148265] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 with Priority: HIGH for action security_group_rules [ 1300.148366] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 with Priority: HIGH for action security_group_rules [ 1300.148460] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 with Priority: HIGH for action security_group_rules [ 1300.148550] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 with Priority: HIGH for action security_group_rules [ 1300.148655] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 with Priority: HIGH for action security_group_rules [ 1300.148751] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ded108-574f-4c27-b008-f6c2b759b560 with Priority: HIGH for action security_group_rules [ 1300.148942] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 with Priority: HIGH for action security_group_rules [ 1300.148942] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 with Priority: HIGH for action security_group_rules [ 1300.149017] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e with Priority: HIGH for action security_group_rules [ 1300.149105] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 with Priority: HIGH for action security_group_rules [ 1300.149196] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a with Priority: HIGH for action security_group_rules [ 1300.149279] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 with Priority: HIGH for action security_group_rules [ 1300.149363] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGH for action security_group_rules [ 1300.149439] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGH for action security_group_rules [ 1300.149528] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGH for action security_group_rules [ 1300.149628] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e84459-f201-4bd5-a48a-e23c87203964 with Priority: HIGH for action security_group_rules [ 1300.149694] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 with Priority: HIGH for action security_group_rules [ 1300.149779] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c with Priority: HIGH for action security_group_rules [ 1300.150178] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.150322] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.150390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.150595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.150674] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b366224-1a8e-4eba-8bca-4fdd69ef52e9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.151958] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-975f007e-412c-4399-9443-27166cb23d7c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.152134] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.152215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.152406] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.152471] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('975f007e-412c-4399-9443-27166cb23d7c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.153277] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21e4fff-6a13-4f07-b2f4-df10109513b4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.153420] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.153468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.153617] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.153695] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21e4fff-6a13-4f07-b2f4-df10109513b4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.154436] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.154558] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.154627] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.154805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.154890] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c7676a-9165-4a1a-b58b-8faa9c5567b8',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.155689] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.155754] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.155794] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.155955] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.156057] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41bb08da-7387-43a0-b7d4-fffc0c3a3846',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.156940] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adb68513-ddb5-44a7-8610-69e7dc83ba07 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.157071] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.157148] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.157301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.157373] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adb68513-ddb5-44a7-8610-69e7dc83ba07',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.158095] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.158231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.158299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.158446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.158530] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d22e7a7e-27b7-45b2-ac98-bd568f361a92',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.159240] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2ded108-574f-4c27-b008-f6c2b759b560 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.159352] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.159418] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.159582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.159667] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2ded108-574f-4c27-b008-f6c2b759b560',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.160369] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.160476] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.160540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.160712] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.160783] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.161595] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.161736] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.161802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.161997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.162111] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17b3806-a6cb-4d6d-91a2-9df7fad51245',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.162862] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-312ecf31-d6a5-4636-8de5-71be8f37e76e taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.162986] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.163124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.163299] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.163388] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('312ecf31-d6a5-4636-8de5-71be8f37e76e',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.164127] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0192141c-b766-4f81-bfc9-7eab487b7c37 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.164262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.164412] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.164475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.164566] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0192141c-b766-4f81-bfc9-7eab487b7c37',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.165429] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.165567] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.165629] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.165805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.165875] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c86f5e-5e15-4193-915e-454c2a0bcd6a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.166598] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.167030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.167030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.167030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.167163] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.167847] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.168084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.168084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.168277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.168359] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.169120] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.169494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.169494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.169494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.169640] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.170409] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.170531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.170606] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.170771] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.170875] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.171742] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1e84459-f201-4bd5-a48a-e23c87203964 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.171742] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.171927] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.171979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.172033] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1e84459-f201-4bd5-a48a-e23c87203964',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.172900] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.172900] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.173096] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.173191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.173291] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac26ea2-8225-41e9-86ff-af5852ae5ae4',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.176248] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d7211d-4d95-4d68-a449-61e8c3acb85c taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.176248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.176248] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.176377] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.176408] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d7211d-4d95-4d68-a449-61e8c3acb85c',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.215517] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.215517] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.215763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.215763] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.218282] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.218445] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.219179] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.219280] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.220010] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.220127] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.222025] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.222123] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.236619] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.236733] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41bb08da-7387-43a0-b7d4-fffc0c3a3846 is going to be deleted. [ 1300.237651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.237855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.255988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.256163] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21e4fff-6a13-4f07-b2f4-df10109513b4 is going to be deleted. [ 1300.257516] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.257773] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.277795] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.277962] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c7676a-9165-4a1a-b58b-8faa9c5567b8 is going to be deleted. [ 1300.279078] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.279301] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.296128] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.296347] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.304532] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.304723] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b366224-1a8e-4eba-8bca-4fdd69ef52e9 is going to be deleted. [ 1300.305753] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.305998] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.321492] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.321720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.329342] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.329521] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 975f007e-412c-4399-9443-27166cb23d7c is going to be deleted. [ 1300.330443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.330657] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.330747] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.330866] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41bb08da-7387-43a0-b7d4-fffc0c3a3846" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.331036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.331200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.331279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.331391] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21e4fff-6a13-4f07-b2f4-df10109513b4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.347275] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.347481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.347481] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.347694] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.347937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.348215] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c7676a-9165-4a1a-b58b-8faa9c5567b8" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.440926] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.441204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.441204] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.441379] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.441441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.441554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-975f007e-412c-4399-9443-27166cb23d7c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.442876] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.443038] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.443090] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.443286] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.443392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.443494] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b366224-1a8e-4eba-8bca-4fdd69ef52e9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.681105] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.681321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.681321] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.681519] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.681691] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.681788] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.681851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.681989] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.682084] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.682168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.682254] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.685948] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.686173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.686173] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.686315] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.686686] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.686686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.686686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.686686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.686979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.686979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.686979] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.688540] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.688699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.688699] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.688843] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.688996] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.689179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.689179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.689354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.689354] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.689453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.689530] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.717227] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.717448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.717448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.717637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.729696] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.729964] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.730687] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.730853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.731638] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.731780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.732539] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.732662] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.733432] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.733565] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.734384] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.734518] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.735316] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.735432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.736129] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.736231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.737061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.737194] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2ded108-574f-4c27-b008-f6c2b759b560 is going to be deleted. [ 1300.738607] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.738691] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.738766] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.738963] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.740464] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.740549] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.741283] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.741381] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.763066] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.763652] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.763805] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d7211d-4d95-4d68-a449-61e8c3acb85c is going to be deleted. [ 1300.764702] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.764929] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.797453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.797613] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1e84459-f201-4bd5-a48a-e23c87203964 is going to be deleted. [ 1300.798485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.798693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.826960] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.827191] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.828837] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.828971] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.834194] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.834313] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adb68513-ddb5-44a7-8610-69e7dc83ba07 is going to be deleted. [ 1300.835250] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.835460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.858875] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.859107] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.863417] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.863543] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 312ecf31-d6a5-4636-8de5-71be8f37e76e is going to be deleted. [ 1300.864422] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.864682] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.887316] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.887531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.894228] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.894351] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac26ea2-8225-41e9-86ff-af5852ae5ae4 is going to be deleted. [ 1300.895259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.895465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.921793] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.921976] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17b3806-a6cb-4d6d-91a2-9df7fad51245 is going to be deleted. [ 1300.922839] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.923094] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.996026] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.996201] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5 is going to be deleted. [ 1300.997111] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.997319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.998757] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.998877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.000668] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.000767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.045302] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.045483] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0192141c-b766-4f81-bfc9-7eab487b7c37 is going to be deleted. [ 1301.046470] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.046621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.050111] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.050277] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.094635] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.094782] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c86f5e-5e15-4193-915e-454c2a0bcd6a is going to be deleted. [ 1301.095772] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.096037] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.127566] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.127713] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.150169] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.150522] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1 is going to be deleted. [ 1301.151254] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.151475] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.154757] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.154877] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.192619] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.193681] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.195289] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.196737] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.196899] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d22e7a7e-27b7-45b2-ac98-bd568f361a92 is going to be deleted. [ 1301.197812] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.198262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.198262] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.198374] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d7211d-4d95-4d68-a449-61e8c3acb85c" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.198934] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.199019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.199116] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.199237] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2ded108-574f-4c27-b008-f6c2b759b560" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.199762] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.199937] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.200047] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.200171] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1e84459-f201-4bd5-a48a-e23c87203964" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.200304] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.200449] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.200524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.200637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adb68513-ddb5-44a7-8610-69e7dc83ba07" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.200759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.200899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.200973] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.201102] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-312ecf31-d6a5-4636-8de5-71be8f37e76e" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.201227] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.201364] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.201438] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.201554] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac26ea2-8225-41e9-86ff-af5852ae5ae4" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.202253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.202580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.202580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.202580] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17b3806-a6cb-4d6d-91a2-9df7fad51245" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.202709] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.202846] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.202923] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.203045] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d83ceb1-7643-4fbf-8cc1-c8afc3c0a8b5" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.203170] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.203307] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.203566] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.203566] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0192141c-b766-4f81-bfc9-7eab487b7c37" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.244331] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.244550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.244550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.244784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.244862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.244990] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c86f5e-5e15-4193-915e-454c2a0bcd6a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.261972] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.262175] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.262260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.262496] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.262588] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.262711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e41f2d5-8bf7-4cd4-a2e3-a00a6438cba1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.335561] env[65788]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1301.336198] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.336423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.336423] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.336621] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.336708] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.336868] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d22e7a7e-27b7-45b2-ac98-bd568f361a92" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.696208] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec: rpc.has_security_group_logging(os_id): False [ 1301.699017] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9: rpc.has_security_group_logging(os_id): False [ 1301.699933] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78cf75a9-6fba-4c9b-bfad-3d1090cb819d: rpc.has_security_group_logging(os_id): False [ 1301.717605] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.717803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.717803] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.718011] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.719553] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.719697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.722061] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.722172] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.735313] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.735575] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.735697] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.735759] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.735914] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.735997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.736111] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 is going to be updated. [ 1301.737085] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.737255] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.754017] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.754337] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.754433] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.754504] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.754704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.754787] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.754860] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1301.756041] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.756231] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.776983] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.777453] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.777632] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.777735] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.778056] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.778200] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.778352] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1301.799063] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.799819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.799819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.799819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.799819] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.815107] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: IN_PROGRESS for 2s [ 1301.822321] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.822490] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.822530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.822733] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.822876] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.841678] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1301.845933] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.846132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.846210] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.846441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.846572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.864322] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1303.830107] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: SUCCESS [ 1303.830525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.855606] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1303.855798] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.877609] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1303.877830] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.150488] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.150855] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1310.151886] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.152263] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.152706] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.153221] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.196777] env[65788]: INFO networking_nsxv3.common.synchronization [req-f2a34153-7109-4105-a9bd-e3e88ee7ff48 req-6d6a7bdc-628c-4e55-b9ac-1aafa8cce736 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1318.198236] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1318.199037] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.199268] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.199355] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.199582] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.200480] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.201167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.201167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.201282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.201282] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.201416] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.705109] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.705363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.705363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.705706] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.705835] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.706163] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.706332] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.706426] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.706626] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.706756] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.706882] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1318.736561] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.736814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.736814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.736919] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.737139] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.746570] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1320.759408] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1320.759855] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d deletion is rescheduled due to dependency. [ 1320.759855] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.199328] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.199735] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.828064] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.828438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.828438] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.828643] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.828906] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.829130] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.829266] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.829492] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.830075] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.830075] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1325.830075] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1325.830075] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1325.830267] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1325.830267] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1325.830388] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1325.830487] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1325.856090] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1325.856459] env[65788]: DEBUG dogpile.cache.region [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1325.856722] env[65788]: DEBUG dogpile.lock [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1325.857019] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "network-888" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.857561] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock port-e411457e-0a0f-4150-8023-0de1113795c9 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.857856] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.858177] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.858684] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.858904] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e411457e-0a0f-4150-8023-0de1113795c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.361634] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.361876] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.362011] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.362296] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.362444] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.362740] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.362897] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.363024] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.363246] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.363422] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.363667] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.363819] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.363936] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.364155] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.364291] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.364432] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Resource: SegmentPort with ID: e411457e-0a0f-4150-8023-0de1113795c9 is going to be updated. [ 1326.385368] env[65788]: DEBUG networking_nsxv3.common.locking [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.385633] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.385701] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.385948] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.386170] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.386393] env[65788]: DEBUG oslo_concurrency.lockutils [None req-40c09199-0f6b-4a24-b830-9cad69378fd9 None None] Releasing lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.068444] env[65788]: INFO networking_nsxv3.common.synchronization [req-85a2fb14-04f3-4d7c-abf2-ef70526dff9f req-d33df3b0-2f64-44e4-b87c-cd519b726794 service nova] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1327.068697] env[65788]: INFO networking_nsxv3.common.synchronization [req-85a2fb14-04f3-4d7c-abf2-ef70526dff9f req-d33df3b0-2f64-44e4-b87c-cd519b726794 service nova] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1327.068743] env[65788]: INFO networking_nsxv3.common.synchronization [req-85a2fb14-04f3-4d7c-abf2-ef70526dff9f req-d33df3b0-2f64-44e4-b87c-cd519b726794 service nova] Enqueued Resource ID: e411457e-0a0f-4150-8023-0de1113795c9 with Priority: HIGHEST for action port [ 1327.069700] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_rules [ 1327.069844] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1327.069944] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e411457e-0a0f-4150-8023-0de1113795c9 with Priority: HIGHEST for action port [ 1327.070245] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.070550] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.070647] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.070849] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.070932] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.072086] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.072274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.072274] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.073069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.073069] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.073069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.073069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.073069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.073069] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.073069] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.074962] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-e411457e-0a0f-4150-8023-0de1113795c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.074962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.074962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.074962] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.074962] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e411457e-0a0f-4150-8023-0de1113795c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.402187] env[65788]: INFO networking_nsxv3.common.synchronization [req-6f41b1e1-4f5c-4a31-b1ca-349b9c6273b5 req-665c6cab-277a-4d2b-b704-2b28ff117b8c tempest-AttachVolumeNegativeTest-1103371124 tempest-AttachVolumeNegativeTest-1103371124-project-member] Enqueued Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_members [ 1327.402187] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44bfaf3-33b0-464c-89a8-bab12493422a with Priority: HIGHEST for action security_group_members [ 1327.402187] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-e44bfaf3-33b0-464c-89a8-bab12493422a taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.402187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.402187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.402187] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.403024] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.403184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.403259] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.403441] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.403531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.403646] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e44bfaf3-33b0-464c-89a8-bab12493422a',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.576084] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.576235] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.577569] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.578517] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e411457e-0a0f-4150-8023-0de1113795c9 with status ACTIVE [ 1327.578728] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.579154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.579154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.579154] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.579411] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.579457] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.579562] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.579625] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.579786] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.579861] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.580053] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.580146] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.581061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.581061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.581061] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.581061] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e411457e-0a0f-4150-8023-0de1113795c9 is going to be updated. [ 1327.604591] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.604864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.604864] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.605124] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.605276] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.605448] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e411457e-0a0f-4150-8023-0de1113795c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.908337] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.908540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.908540] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.908704] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.930400] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.930631] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.930750] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.930816] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.931021] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.931108] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.931201] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e44bfaf3-33b0-464c-89a8-bab12493422a is going to be updated. [ 1327.956926] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.957181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.957181] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.957362] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.957503] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.966654] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e44bfaf3-33b0-464c-89a8-bab12493422a in Status: IN_PROGRESS for 2s [ 1328.082242] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.504448] env[65788]: INFO networking_nsxv3.common.synchronization [req-c2b2ba79-6193-408b-a28d-35256c20f597 req-70ce5b6a-6e59-48a8-b74b-9b80e04b6cdf tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1328.505137] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1328.505811] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.506814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.506814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.506814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.506814] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.506814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.506814] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.507363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.507363] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.507363] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.585097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.585891] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.585997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.586265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.586393] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.587198] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 is going to be updated. [ 1328.617099] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.617290] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.617368] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.617545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.617685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.626799] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: IN_PROGRESS for 2s [ 1328.873417] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.873632] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.873789] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.874072] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.874377] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.874570] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.874737] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.875023] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.875188] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.875409] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1328.875522] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1328.875663] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1328.875771] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1328.875886] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1328.875991] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1328.876136] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1328.895786] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1328.895981] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1328.896108] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1328.896286] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-193" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.896622] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-36b01392-d3c5-42fc-b046-d43ff7ad8943 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.896774] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.896893] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.897307] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.897444] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b01392-d3c5-42fc-b046-d43ff7ad8943',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.011278] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.011453] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.011552] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.011784] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.011933] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.012055] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.012167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.012246] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.012394] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.012471] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.012558] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1329.045414] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.045598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.045598] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.045805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.045956] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.054354] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1329.399618] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.399969] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.400032] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.400281] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.400435] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.400589] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Segment Port 36b01392-d3c5-42fc-b046-d43ff7ad8943 not found, creating... [ 1329.400882] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.401074] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.401258] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.401417] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.401549] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.401833] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.401986] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.402151] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.402339] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.402473] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.402615] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 36b01392-d3c5-42fc-b046-d43ff7ad8943 is going to be created. [ 1329.425983] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.426301] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.426389] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.426626] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.426845] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.427112] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.977673] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e44bfaf3-33b0-464c-89a8-bab12493422a in Status: SUCCESS [ 1329.977881] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e44bfaf3-33b0-464c-89a8-bab12493422a deletion is rescheduled due to dependency. [ 1329.977979] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e44bfaf3-33b0-464c-89a8-bab12493422a" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.125054] env[65788]: INFO networking_nsxv3.common.synchronization [req-c2b2ba79-6193-408b-a28d-35256c20f597 req-6f219e6c-ebc3-489e-b2b4-83bd6f274769 service nova] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 1330.125278] env[65788]: INFO networking_nsxv3.common.synchronization [req-c2b2ba79-6193-408b-a28d-35256c20f597 req-6f219e6c-ebc3-489e-b2b4-83bd6f274769 service nova] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1330.125481] env[65788]: INFO networking_nsxv3.common.synchronization [req-c2b2ba79-6193-408b-a28d-35256c20f597 req-6f219e6c-ebc3-489e-b2b4-83bd6f274769 service nova] Enqueued Resource ID: 36b01392-d3c5-42fc-b046-d43ff7ad8943 with Priority: HIGHEST for action port [ 1330.125922] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_rules [ 1330.126088] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1330.126256] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b01392-d3c5-42fc-b046-d43ff7ad8943 with Priority: HIGHEST for action port [ 1330.126598] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.126780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.126780] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.126994] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.127168] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.128048] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.128144] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.128387] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-36b01392-d3c5-42fc-b046-d43ff7ad8943 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.128474] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.128508] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.128656] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.128759] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b01392-d3c5-42fc-b046-d43ff7ad8943',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.630152] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.630512] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.630555] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36b01392-d3c5-42fc-b046-d43ff7ad8943 with status ACTIVE [ 1330.630717] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.630831] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.630899] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.631151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.631265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.631437] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.631538] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.631648] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.631792] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.631880] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.632087] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.632184] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.632265] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.632392] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.632485] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.632573] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36b01392-d3c5-42fc-b046-d43ff7ad8943 is going to be updated. [ 1330.637921] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: SUCCESS [ 1330.638133] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.638395] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.638667] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.638880] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.639030] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.639076] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.639226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.639326] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.639465] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.639563] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.657019] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.657019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.657019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.657019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.657019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.657358] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36b01392-d3c5-42fc-b046-d43ff7ad8943" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.064933] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1331.065194] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d deletion is rescheduled due to dependency. [ 1331.065341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.065530] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.065824] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.066078] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.066207] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.066275] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.066442] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.066545] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.066655] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.141315] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.569161] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.644282] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9: rpc.has_security_group_logging(os_id): False [ 1331.665869] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.665869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.665869] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.666166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.666166] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.666358] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.666585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.666585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.666723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.666805] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.666893] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 is going to be updated. [ 1331.745463] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.745813] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.745904] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.746251] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.746388] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.760912] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: IN_PROGRESS for 2s [ 1332.072526] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.575167] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.575167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.575167] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.575443] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.575492] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.575607] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1332.609777] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.609997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.609997] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.610179] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.610334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.621722] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1333.783131] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: SUCCESS [ 1333.783531] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.632829] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1334.633087] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.633334] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.633589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.633815] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.633960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.634074] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.634253] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.634341] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.634431] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.634543] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.127679] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.128135] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1335.136421] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.640041] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78cf75a9-6fba-4c9b-bfad-3d1090cb819d: rpc.has_security_group_logging(os_id): False [ 1335.662581] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.662811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.662811] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.663019] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.663109] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.663356] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.663460] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.663526] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.663686] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.663764] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.663876] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1335.725862] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.726112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.726112] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.726319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.726468] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.743304] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1337.324025] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.324025] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.324025] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.324025] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.324738] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.324738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.324738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.324738] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.324914] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.324989] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1337.325116] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] NeedRegenerationException {{(pid=65788) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1337.325231] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] no value, waiting for create lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1337.325341] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] value creation lock acquired {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1337.325451] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] No value present for key: 'zone-id' {{(pid=65788) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1337.326743] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Calling creation function for not-yet-present value {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1337.326743] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1337.344778] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1337.345019] env[65788]: DEBUG dogpile.cache.region [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65788) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1337.345072] env[65788]: DEBUG dogpile.lock [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Released creation lock {{(pid=65788) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1337.345297] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "network-81" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.345621] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock port-99ba3884-6c7e-42a5-9836-1d435c1734e1 taken with stack trace [, , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.345797] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.346074] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.346200] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.346324] env[65788]: DEBUG networking_nsxv3.api.rpc [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ba3884-6c7e-42a5-9836-1d435c1734e1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.758400] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1337.758589] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.849110] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.849362] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.849450] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.849736] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.849880] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.850188] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.850411] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.850535] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.850749] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.850880] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.851178] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.851337] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.851451] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.851726] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.851869] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.852013] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Resource: SegmentPort with ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 is going to be updated. [ 1337.871876] env[65788]: DEBUG networking_nsxv3.common.locking [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.872133] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.872208] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.872442] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.872714] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.872934] env[65788]: DEBUG oslo_concurrency.lockutils [None req-dbedef8a-68fc-40c4-b280-68a77f50cd72 None None] Releasing lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.589639] env[65788]: INFO networking_nsxv3.common.synchronization [req-0b8d5a5a-a15e-4522-bf9d-3166adbdfdff req-4a379b5e-5d1d-4fa8-a779-471ba483251e service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 1338.589940] env[65788]: INFO networking_nsxv3.common.synchronization [req-0b8d5a5a-a15e-4522-bf9d-3166adbdfdff req-4a379b5e-5d1d-4fa8-a779-471ba483251e service nova] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1338.589940] env[65788]: INFO networking_nsxv3.common.synchronization [req-0b8d5a5a-a15e-4522-bf9d-3166adbdfdff req-4a379b5e-5d1d-4fa8-a779-471ba483251e service nova] Enqueued Resource ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 with Priority: HIGHEST for action port [ 1338.590441] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_rules [ 1338.590584] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1338.590681] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 with Priority: HIGHEST for action port [ 1338.590955] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.591088] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.591149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.591338] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.591420] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.592714] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.593651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.593651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.593651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.593651] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.593651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.593651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.593651] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.593961] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.593961] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.594767] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ba3884-6c7e-42a5-9836-1d435c1734e1 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.595421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.595421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.595421] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.595421] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ba3884-6c7e-42a5-9836-1d435c1734e1',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.097333] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.098508] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.098637] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.098819] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99ba3884-6c7e-42a5-9836-1d435c1734e1 with status ACTIVE [ 1339.099021] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.099151] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.099226] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.099436] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.099528] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.099702] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.099802] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.099867] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.100954] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.101132] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.101381] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.101513] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.101603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.101817] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.101916] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.102012] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99ba3884-6c7e-42a5-9836-1d435c1734e1 is going to be updated. [ 1339.125194] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.125365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.125365] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.125572] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.125714] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.125873] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ba3884-6c7e-42a5-9836-1d435c1734e1" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.605229] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.107990] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.108279] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.108340] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.108595] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.108711] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.108822] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1340.138514] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.138720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.138720] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.138853] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.138995] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.148088] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1342.159481] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1342.159863] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.159907] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.160117] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.160316] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.160440] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.160506] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.160655] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.160767] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.160871] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.160960] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.663241] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.166276] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec: rpc.has_security_group_logging(os_id): False [ 1343.184183] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.184378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.184378] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.184603] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.184693] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.184944] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.185072] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.185142] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.185306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.185387] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.185473] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1343.244769] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.244769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.244769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.244769] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.245043] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.260852] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1343.591886] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.591987] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1345.279991] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1345.280249] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.593428] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.593838] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.594350] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.594637] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.206386] env[65788]: INFO networking_nsxv3.common.synchronization [req-ceac38bc-1c18-420c-b97b-5887024fae02 req-405e4ce3-a463-4414-8d95-2d1f54cb5b35 tempest-ServerActionsTestOtherB-1448945327 tempest-ServerActionsTestOtherB-1448945327-project-member] Enqueued Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1357.206386] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec with Priority: HIGHEST for action security_group_members [ 1357.206685] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.206685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.206685] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.206851] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.206982] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.207138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.207138] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.207221] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.207306] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.207422] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.710781] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.711036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.711036] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.711366] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.711495] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.711727] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.711862] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.711948] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.712147] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.712256] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.712666] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec is going to be updated. [ 1357.741391] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.741601] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.741601] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.741818] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.741960] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.750531] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: IN_PROGRESS for 2s [ 1359.762520] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec in Status: SUCCESS [ 1359.762520] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec deletion is rescheduled due to dependency. [ 1359.762520] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f1d4b75-01e9-4cbd-a83d-f69a43ff8fec" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.206891] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.207195] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.208285] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.208698] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.210081] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.210397] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.211852] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.211852] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.607315] env[65788]: INFO networking_nsxv3.common.synchronization [req-5c994541-a967-4944-a502-4c222294e462 req-fed05306-63b5-4913-81e5-8a1971ce1b5f tempest-AttachVolumeShelveTestJSON-1220373225 tempest-AttachVolumeShelveTestJSON-1220373225-project-member] Enqueued Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1378.607929] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 with Priority: HIGHEST for action security_group_members [ 1378.608274] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.608405] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.608479] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.608718] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.608891] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.609009] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.609078] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.609234] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.609585] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.609585] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f4eed26-2bee-4114-b8b7-1b3c1d2368c9',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.112097] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.112308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.112308] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.112432] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.112524] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.112744] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.112852] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.112926] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.113296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.113296] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.113296] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 is going to be updated. [ 1379.141838] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.142168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.142168] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.142294] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.142390] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.151535] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: IN_PROGRESS for 2s [ 1381.163070] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 in Status: SUCCESS [ 1381.163488] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4eed26-2bee-4114-b8b7-1b3c1d2368c9 deletion is rescheduled due to dependency. [ 1381.163488] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4eed26-2bee-4114-b8b7-1b3c1d2368c9" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.609377] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.609751] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.610568] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.610930] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.612359] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.612783] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.985519] env[65788]: INFO networking_nsxv3.common.synchronization [req-1d96b63e-509a-459f-8eb4-64f7de5040be req-05818ece-24e8-44a1-b66b-40a5169aeb55 tempest-ServerActionsTestJSON-1322561610 tempest-ServerActionsTestJSON-1322561610-project-member] Enqueued Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1394.986207] env[65788]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d with Priority: HIGHEST for action security_group_members [ 1394.986524] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d taken with stack trace [, , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.986988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.986988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.986988] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.987182] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.987260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.987260] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.987447] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.987544] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.987660] env[65788]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78cf75a9-6fba-4c9b-bfad-3d1090cb819d',) {} {{(pid=65788) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.491227] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.491446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.491446] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.491639] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.491731] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.491937] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.492035] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.492100] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.492244] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.492319] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.492406] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d is going to be updated. [ 1395.521301] env[65788]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65788) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.521525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.521525] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.521723] env[65788]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.521847] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.530179] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: IN_PROGRESS for 2s [ 1397.540734] env[65788]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d in Status: SUCCESS [ 1397.541149] env[65788]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78cf75a9-6fba-4c9b-bfad-3d1090cb819d deletion is rescheduled due to dependency. [ 1397.541149] env[65788]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78cf75a9-6fba-4c9b-bfad-3d1090cb819d" {{(pid=65788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.987383] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.987687] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.989164] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.989546] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.989979] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.990410] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.991613] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.991997] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.992980] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.993307] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.994195] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.994620] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.995515] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.995872] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.996206] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.996622] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.997068] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.997507] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.998609] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.998609] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.000270] env[65788]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.000664] env[65788]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0